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ABSTRACT 

-The  pursuit-evasion  aspect  of  the  two  aircraft  combat  problem  is 
introduced  as  a  fixed  time,  zero  sum,  perfect  information  differential 
game.  The  purpose  of Itil&e  dissertation  is  to  solve  this  differential 
game  problem  and  to  obtain  closed- loop  guidance  or  control  laws.  A 
realistic  aircraft  model  is  presented  for  which  a  solution  of  this 
combat  problem  is  desired^*') Because  of  the  non-linear  dynamics  assoc¬ 
iated  with  this  model,  an  optimal  closed-loop  solution  cannot  be 
obtained.  Three  additional  simplified  aircraft  models  are  introduced 
as  approximations  to  the  realistic  model.  Optimal  solutions  and 
closed- loop  control  laws  are  obtained  for  each  of  these  models. 

Analysis  of  the  solutions  and  control  laws  reveals  that  they  are 
characteristically  similar  and  to  a  certain  extent  independent  of  the 
aircraft  model.  This  enables  the  formulation  of  an  approximate 
closed-loop  control  law  for  use  with  the  original  realistic  model. 

The  optimality  of  this  control  law  is  established  by  applying  it  to 
the  pursuer  in  a  differential  game  problem  while  the  evader  determines 
the  best  open-loop  evasive  strategy. 
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I.  INTRODUCTION 

In  recent  years,  the  problem  of  determining  the  performance 
requirements  for  a  superiority  fighter  aircraft  has  received  the 
attention  of  many  researchers.  The  basic  difficulty  is  the  lack 
of  numerical  measures  to  evaluate  the  effectiveness  of  one  aircraft 
when  pitted  against  another  in  a  competitive  or  combative  situation. 
During  an  aircraft  combat  engagement  there  are  periods  when  one 
or  both  aircraft  may  be  passive,  aggressive  or  evasive  depending 
upon  the  relative  capabilities  and  positions  of  the  aircraft  and 
the  desires  of  the  pilots. 

This  dissertation  considers  the  pursuit-evasion  aspect  of  the 
combat  problem.  One  approach  to  the  solution  of  this  problem  is 
to  determine  the  control  of  one  aircraft  which  pursues  in  some 
optimal  manner  another  aircraft  which  either  employs  a  predetermined 
control  law  or  follows  a  pre-specified  trajectory.  The  difficulty 
associated  with  this  approach  is  that  the  optimal  solution  to  one 
problem  is  not  optimal  if  either  the  pre-specified  control  law  or 
trajectory  is  changed.  Simply  stated  this  means  that  no  one  guidance 
scheme  is  optimal  against  all  types  of  evasion.  If  optimal  pursuit 
and  optimal  evasion  can  be  considered  together,  it  becomes  possible 
to  derive  a  numerical  measure  reflecting  the  capabilities  of  the  t^o 
aircraft.  The  problem  of  determining  the  optimal  controls  for  such 
a  problem  is  a  differential  game  problem.  In  order  to  have  any 
practical  application,  the  solution  to  this  problem  must  provide 
feedback  strategies,  or  what  is  equivalent,  a  continuous  real-time 
solution  of  open-loop  strategies. 
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it  -  s  the  intent  of  the  dissertation  to  determine  optimal  *  ;  v'~  ^ 

.  •»* 

or  near  optimal  feedback  strategies  for  a  pursuit -evasion  differ¬ 
ential  game  between  two  aircraft.  The  solubility  of  this  problem 
is  dependent  on  the  model  chosen  to  represent  the  aircraft.  An 
important  aspect  of  this  study  is  the  investigation  of  different 
aircraft  models,  characterized  by  various  assumptions  and  approxi- 
r  .tions,  in  an  effort  to  determine  optimal  or  "near"  optimal 
-losed-loop  feedback  strategies. 

The  purpose  of  this  study  and  the  realistic  aircraft  model  to 
be  considered  is  discussed  in  Chapter  II.  In  Chapter  III,  a 
differential  game  problem  is  defined.  Necessary  and  sufficient 
conditions  for  a  solution  of  this  problem  are  presented.  Chapters 
»’  thru  VII  are  concerned  with  the  solutions  to  the  pursuit -evasion 
cferential  game  problems  characterized  by  different  aircraft  models. 

,;e  solutions  and  control  laws  derived  in  these  chapters  are  applied 
tvo  realistic  problems  in  Chapter  VIII.  A  closed-loop  control 
m  for  application  with  the  realistic  aircraft  model  is  synthesized 
and  discussed  in  Chapter  IX  •  Conclusions  and  recommendations  are 
presented  in  Chapter  X. 

It  is  believed  that  there  are  two  main  contributions  resulting 
from  this  research.  For  the  first  time,  &  realistic  aircraft 
pursuit -evasion  problem  is  presented  and  solved.  The  solution  to 
this  problem  has  important  application  in  the  areas  of  aircraft 
design  and  performance,  and  aircraft  tactics.  The  second  contribution 
is  the  demonstration  that  reasonable  solutions  to  differential  game 
problems  can  often  be  obtained  through  analysis  of  simplified  models. 

It  is  believed  that  this  differential  game  modeling  approach  can  be 
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applied  to  a  much  larger  class  of  differential  game  problems  involving 
realistic  aircraft  models. 


:  iiC. 3JI3T  OF  THE  PROBLEM 


u . 


;  o3c  of  ui-j-'Crtat ion  and  Approach 
The  purpose  of  this  dissertation  is  to  solve  the  two-aircraft 
vit  evasion  differential  game  and  to  obtain  optimal  closed-loop 
troi  hn/s  or  strategics  for  the  two  aircraft.  The  extent  to 
■pii»rtl  closed-loop  strategies  can  be  determined  is  highly 
cut  on  the  dynamics  chosen  to  represent  the  aircraft.  In  the 
optivnl  feedback  solutions  cannot  be  found,  "near"  optimal 
r  .'rrvcimateiy  optimal  feedback  strategies  are  sought. 

in  approaching  this  task,  a  standard  aircraft  model  is  defined. 
Application  of  the  necessary  conditions  for  a  saddle  point  solution 
1  .  two  point  boundary  value  problem,  for  which  closed-loop 

i  laws  could  not  be  found.  Open-loop  controls  and  solutions 
.’-tained,  however,  by  means  of  iterative  numerical  techniques. 

step  is  to  determine  what  simplifications  can  be  made  to 
.  Card  model  dynamics  so  that  closed-loop  strategies  can  be 
t*ned.  Three  simplified  aircraft  models  are  considered  and 
.  js  -d-loop  strategies  are  obtained  for  each. 

.  c  is  discovered  that  the  optimal  paths  for  the  differential 
.e  problem  solutions  with  the  simplified  models  exhibit  similar 
<  •  r  ,-i  istics  to  the  optimal  paths  obtained  for  the  standard 

The  similarity  of  solutions  suggests  a  method  of  synthesiz- 
, ..  ivedback  control  law  for  the  standard  model.  The  optimality  of 
.  synthesized  control  law  is  evaluated  by  formulating  a  one-sided 
rontial  game  or  optimal  control  problem  in  which  the  path  of 
-u-Micr  is  determined  through  application  of  this  control  law 
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while  the  path  of  the  evader  is  optimized  against  it. 

Differential  Gene  Problem 

The  pursuit>evasion  problea  is  to  be  formulated  as  a  two  player, 
zero  sum,  perfect  information  differential  game.  The  game  is  assumed 
to  take  place  in  the  vertical  plane  and  terminates  when  the  terminal 
manifold  defined  by 

♦  Ct£,  x  (tp]  -  T  -  tf  -  0 

is  reached.  T  is  a  fixed  specified  tine,  t£  is  the  time  when  the 
terminal  manifold  is  reached  and  x  (t£)  is  an  n  dimensional  vector 
representing  the  state  of  the  game  evaluated  at  the  terminal  manifold. 
The  range  (R)  between  the  two  vehicles  at  termination  is  the  payoff 
and  is  denoted  as  J.  It  becomes  obvious,  then,  that  in  this  pursuit* 
evasion  game  the  evader  will  strive  to  maximize  the  range  at  tormina* 
tion  and  the  pursuer  will  want  to  minimize  R  at  termination.  Thus, 
one  player's  gain  is  the  other  player's  loss.  Such  games  are  referred 
to  as  zero  sum  differential  games.  The  game  is  assumed  to  be  a  game 
cf  perfect  information,  where  each  player  (aircraft)  knows  the  present 
state  of  the  game  x  (t)  along  with  the  dynamics  and  capabilities  of 
his  opponent. 

Aircraft  Dynamics 

Hie  following  assumptions  are  made  in  regard  to  the  aircraft 
dynamics: 

(a)  The  aircraft  are  considered  to  be  point  masses. 

(b)  The  eerth  is  flat  and  the  acceleration  of  gravity  is 
constant. 
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(c)  The  thrust  is  constant  and  tangent  to  the  flight  path. 

(d)  The  aircraft  weight  is  constant. 

ui  light  of  these  assumptions  the  aircraft  equations  of  motion 

x  »  V  cos  y 

h  a  V  sin  y 

Vx  =  (G/W)  [{T  -  D)  cos  y  -  L  sin  y} 

Vu  «  (G/W)  { (T  -  D)  sin  y  ♦  L  cos  y]  -  G 

ft 

; »  f  is  defined  by 

Y  -  tan'1  (Vh/Vx) 

ienotes  the  horizontal  distance,  h  the  altitude,  V  and  V  are  the 

x  h 

h  components  of  velocity  V,  y  the  flight  path  inclination,  W 
.^ight,  D  the  drag,  L  the  lift,  T  the  thrust  and  G  the  acceleration 
v'ri'vity.  The  forces  acting  on  the  aircraft  are  shown  in  Figure  1. 


Figure  1.  Aircraft  Forces 
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The  aerodynamic  forces  are  defined  by 

D  -  l/2p  V2  S  Cn  ,  L  -  i/2o  V2  S  C 


where  p  is  the  air  density,  S  a  reference  area,  the  drag  coeffi¬ 
cient  and  C  the  lift  coefficient. 

L 

Id  general,  (Ref  (11]),  Cp  and  are  functions  of  the  angle  of 
attach  o,  the  Kach  number  M  and  the  Reynolds  number  Re  with  the 
functional  relationships 


CD  ’  CD  M’  Re) 


c?  -  CL  (o,  M,  Ro) 


For  angles  of  attack  below  the  stalling  point  a  can  be  eliminated 

from  the  above  relationships  to  yield 

C_  -  C  (C  ,  M,  Re) 

DDL 

which  is  called  the  drag  polar.  For  relatively  constant  values  of  M 

and  Re  the  dependence  of  on  M  and  Re  can  be  neglected.  If  the 

assumption  is  made  that  the  drag  polar  is  parabolic  with  constant 

coefficients,  the  drag  and  lift  coefficients  satisfy  the  relationship 

C  -  C  ♦  k  C  2 
D  DO  L 

where  C  is  the  zero-lift  drag  coefficient  and  k  the  induced  drag 
DO 

factor.  The  assumption  that  the  drag  polar  is  parabolic  is  in  many 
cases  a  good  approximation  to  the  experimental  polar.  Its  accuracy 
depends  on  the  lift  coefficient  as  well  as  the  aircraft  configuration. 
This  approximation  is  extremely  useful  in  analytical  work  and  is 
therefore  widely  used. 

2 

The  additional  assumption  of  constant  dynamic  pressure  (Q>l/2p  V  ) 
is  made.  This  assumption  is  not  severe  for  the  pursuit -evasion  game 
where  velocity  and  altitude  changes  are  minimal.  This  leads  to  the 


o 


7 


'ion  of  motion  which  are  referred  to  in  this  study  as  the  standard 

-  ; ft  model. 


X  a  V  a  V  COS  Y 
X 


h  *  V  a  V  sin  y 
h 


3  (Q  S/m)  [  (C  -  k  C  )  cos  y  -  C  sin  y] 
x  T  l  L 


Vh  3  ^  s/ra)I(cT  -  *  C  )  sin  y  ♦  C  cos  y)  -  6 
®  L  L 


-  c  is  a  coefficient  formed  from  QSC  «T  -  OSC  . 
1  T  DO 


iota tion  Vectograms 

fn  (Ref  [10])  Isaacs  introduces  the  concept  of  a  vectogram  to 
.•be  as  a  function  of  the  state  of  the  game  the  allowable  choice 
ontrols  for  each  player.  For  example,  simple  planar  motion  with 
velocity  direction  as  the  control  can  be  depicted  by  the  circular 

-‘.tram  shown  in  Figure  2. 


The  concept  of  control  vectogram s  has  been  a  convenient  one 
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**  during  this  study  because  it  provides  a  visual  description  of  the 

force  relationships  of  the  problea.  For  this  study,  the  definition 
of  a  vectograa  is  Modified  to  include  both  the  thrust  and  aerodynaaic 
forces  acting  on  the  aircraft.  Gravitational  forces  are  not  included. 
The  acceleration  vectograa  for  the  standard  aircraft  aodel  is  shotm 
in  Figure  3. 

Froa  a  vectograa  point  of  view,  the  differential  gaae  problea 
can  be  viewed  as  the  problea  of  deteraining  how  to  eaploy  the  avail¬ 
able  forces  in  order  to  best  pursue  or  evade  the  opposing  player.  It 
is  obvious  that  a  continuous  coaproaise  or  tradeoff  between  force 


Figure  3.  Acceleration  Vectograa  for  Standard  Aircraft  Model 
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magnitude  and  direction  nust  be  made..  The  problem  of  determining  how 
to  employ  the  available  forces  is  difficult  because  the  force  or 
acceleration  magnitude  available  in  a  given  direction  varies  with  the 
aircraft's  flight  path  direction.  The  approach  taken  in  this  study 
is  to  consider  various  simplifications  of  the  standard  aircraft  model 
acceleration  vectogram  that  will  yield  a  problem  for  which  closed-loop 
solutions  can  be  found. 


DS/MC/67-1 


! 

i 

i 


» 

1 


III.  THEORY  OP  DIFFERENTIAL  .-AMES 

The  pursuit-evasion  problems  treated  in  this  study  are  formulated 
as  fixed  time,  zero  sum,  perfect  information  differential  gases.  The 
purpose  of  this  chapter  is  to  define  mathematically  this  class  of 
differential  tames  and  to  present  necessary  and  sufficient  conditions 
for  solutions  to  these  problems.  The  basis  of  this  chapter  can  be 
found  in  References  [1],  [2],  and  [4]. 

Mathematical  Formulation 

The  differential  game  problem  treated  in  this  dissertation  is 
defined  by  the  dynamic  system 

x  «  f  (x,  u,  v,  t)  ;  x  (t  )  •  x  (1) 

“  -  o  ~o 

where  x  is  an  n-vector,  u  is  the  scalar  pursuer  control  and  v  is 

the  scalar  evader  control.  The  goal  is  to  find  the  controls  u  and 

* 

v  such  that 

*  (x  (t^,  tp  »  0 

and  the  performance  criteria 

tf 

J  «  ♦  (x  (t^),  tf)  ♦  J  L  (x,  a.  v,  t)  dt  (2) 

satisfies 

J  (a  »  v)  <  J  (u  ,  v  )  <  J  (u,  v  )  (3) 

#  *  *  * 

If  u  and  v  can  be  found,  the  pair  (u  ,  v  )  is  called  a 

•  * 

saddle  point  of  the  game  and  J  (u  ,  v  )  is  called  the  value  of 
the  game.  Eq  (3)  is  equivalent  to  the  following  equations 
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J  (u  ,  v  )  «  Min  J  (u,  v  ) 
u$U 

~  Max  J  (u  v)  (4) 

vcV 

=  Min  Max  J  (u,  v) 
u£(J  v£V 

where  U  and  V  are  admissible  sets  for  u  and  v. 

£q  (4)  and  hence  the  existence  of  a  saddle  point  are  dependent  - 
on  the  condition  that 

Min  Max  J  (u,  v)  =>  Max  Min  J  (u,  v) 

u£U  v?V  v^V  u£U  (5) 

M  cce s sary  Conditions 

A  necessary  condition  for  a  saddle  point  solution  of  the 
differential  game  problem  defined  by  Eqs  (1),  (2)  and  (3)  is  that 
the  Hamiltonian  defined  by 

T 

H  (t,  x,  X,  u,  v)  *  f  ♦  L  (6) 

most  be  minimized  over  the  set  of  admissible  u  and  maximized  over 

the  set  of  admissible  v  and  that 

H  -  Max  Min  H  *  Min  Max  H 

v  u  u  v  (7) 

X  is  the  n-dimensional  costate  vector  and  the  costate  differential 

equations  are 

•T 

x1  =  -H  (8) 

~  x 

The  transversality  conditions  are  given  by 

*T  (t  J  *  +  (t  J  (9) 

—  f  X  r 

Eq  (7)  implies  that  the  maximization  and  minimization  processes 
commute,  which  is  not  generally  true.  It  is  true,  however,  if  H 
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can  bo  separated  into  two  functions,  one  of  which  is  independent  of 

u  and  the  other  independent  of  v.  For  example 

1  2 

H  (t,  x,  X,  u,  v)  ■  H  (t,  x,  X ,  u)  ♦  H  (t,  x,  X,  v) 

For  the  problems  considered  in  this  dissertation  f,  L,  and  hence  H 

are  separable.  This  insures  that  the  minimizing  u  and  maximizing 

v  provide  a  saddle  point  of  H  at  each  point  on  the  optimal  path. 

Unfortunately,  separability  of  H  does  not  imply  separability  of  J 

and,  therefore,  solutions  to  the  two  point  boundary  value  problem 

given  by  Eqs  (6),  (3),  and  (9),  may  not  necessarily  satisfy  the  saddle 

point  conditions  given  by  Eq  (3).  A  procedure  for  verifying  the  saddle 

point  conditions  are  given  in  the  section  on  sufficient  conditions. 

Necessary  conditions  require  that  the  Hamiltonian  be  minimized 

over  the  set  of  admissible  u  and  maximized  over  the  set  of  admissible 

v.  If  H  is  linear  in  the  control  variables  and  if  3H/3u  and  3H/3v 

are  equal  to  zero  the  Hamiltonian  is  independent  of  u  and  v  and  it 

is  not  possible  to  maximize  or  minimize  H  with  respect  to  these 

controls.  Bctrcmal  arcs  on  which  3H/3u  i  0  or  3H/3v  =  0  are  called 

singular  arcs.  In  (Ref  [1]),  Anderson  presents  the  characteristics 

of  singular  solutions  in  two-person,  zero  sum  differential  games 

including  a  set  of  necessary  conditions  for  the  optimality  of  the 

solution.  Defining  S  =  3H/3u,  necessary  conditions  for  the  existence 

P 

of  a  singular  solution  are  that  S  (x,  X)  and  all  time  derivatives  of 

p  -  - 

S  must  vanish.  Successive  differentiation  of  S  generally  results 
P  P 

in  an  equation  which  explicitly  contains  u  which  allows  the  determina¬ 
tion  of  the  singular  control  u$.  Similar  statements  apply  for  the 

evader  when  S  =  3H/3v  »  0  The  necessary  conditions  for  the  singular 
e 

control  u  to  minimize  J  and  for  v  to  maximize  J  are 
*  s 


13 


DS/MC/67-1 


a  rid 


q 

M)  ?_ 

Du 


c-l)q  1_ 

3v 


(10) 


where  2q  is  the  order  of  the  derivative  which  explicitly  contains 
u  and  v.  No  sufficient  conditions  for  optimality  cf  singular  solutions 

are  available. 

It  was  previously  stated  that  the  optimal  solution  to  the  differ* 

*  * 

ential  game  problem  is  the  pair  of  controls  (u  »  V  )  which  provide  a 

*  •  *  • 

saddle  point  of  J.  If  the  pair  (u  ,  v  )  is  given  as  (u  (t),  v  (t)), 

one  speaks  of  an  open-loop  solution.  If  the  controls  are  expressed 

as  functions  of  the  instantaneous  state  and  ti»e 

u*  =  k  (x,  t) 
u  — 

v  **  k  (x,  t) 
v  “ 

one  has  what  is  known  as  a  feedback  or  closed-loop  control  law. 

The  importance  of  the  difference  between  open  and  closed- loop 

controls  in  differential  games  can  be  made  clear  by  returning  to 

the  inequalities  of  Eq  (3).  The  second  inequality  can  be  considered 

in  two  ways  depending  on  how  the  minimizing  player  considers  the 

maximizing  player's  controls  to  be  expressed.  We  can  have  either 

min  J  [u,  v  (t)J  «  J  (u  (t;  x  ,  t  );  v  (t)J 
..  o 


or 
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■In  J  lu,  k  (x,  t)]  ■  J  [u*  (t;  x  ,  t  );  k  (x,  t)) 

V  “  “0  o  V 

* 

The  latter  requires  that  u  be  optimal  against  an  opponent 
whose  control  is  produced  in  a  closed-loop  manner  implying  that 
v  can  immediately  take  advantage  of  any  non-optimal  play  made  by 
u.  It  is  obvious,  therefore,  that  in  differential  game  problems 
feedback  strategies  must  be  considered.  If  the  open-loop  problem 
can  be  solved  analytically,  the  open- loop  control  can  be  computed 
instantaneously  and  continuously  for  any  initial  state  and  hence 
generate  an  optimal  closed-loop  control. 

If  one  assumes  the  existence  of  strategies 

*  * 
u  ■  k  (x,  t)  and  r  *  k  (x,  t) 
u  —  v  — 

that  provide  a  saddle  point  of  J,  the  following  significance  to 

Eq  (3)  can  be  given.  If  the  maximizing  player  uses  his  optimal 

strategy,  he  is  guaranteed  a  payoff  at  least  equal  to  the  value 
*  * 

J  (u  ,  v  )  and  if  the  minimizing  player  selects  his  optimal  strategy, 
he  guarantees  that  his  opponent  will  get  a  payoff  no  greater  than 
the  value. 

Sufficient  Conditions 

In  the  previous  section,  it  was  pointed  out  that  solutions  to 
the  two  point  boundary  value  problem  given  by  Eq  (6),  (3),  and  (9), 

do  not  necessarily  satisfy  the  saddle  point  conditions 

*  *  *  • 

J  (u  ,  V)  <  J  (u  ,  V  )  <  J  (u,  V  ) 

Verification  of  the  saddle  point  conditions  can  be  accomplished 

directly  by  verifying  the  inequalities  of  Eq  (3)  separately  through 

the  consideration  of  two  optimal  control  problems.  The  first 
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inequality  can  be  verified  by  solving  the  problea 

*  *  * 

J  (u  ,  v  )  a  min  J  (u.  v  ) 

u 

* 

where  v  may  be  given  in  open  or  closed-loop  fora.  The  second 

inequality  is  verified  by  solving  the  problea 

J  (u*,  v*)  a  max  J  (u*,  v) 
v 

* 

where  u  may  be  expressed  in  open  or  closed-loop  fora.  The  saddle 
point  is  established  if  u*  and  v*  froa  both  problens  are  the  saae. 

Sufficient  conditions  for  a  saddle  point  solution  for  this  differ- 
ential  game  problea  are  discussed  in  Appendix  A.  When  u  and  v  are 
interior  controls  the  following  conditions  are  sufficient  for  (u  ,  v  ) 
to  provide  a  saddle  point  of  J. 

(1)  The  strengthened  Legendre-Clebsch  conditions: 


H  >  0 
uu 


<  0 


(2)  The  non-cxistence  of  a  conjugate  point  on  [t  ,  t,) 

o  r 

for  an  accessory  rainieax  problea. 


<  »■ 
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IV.  PURSUIT-EVASION  DIFFERENTIAL  GAME  -  STANDARD  AIRCRAFT  MODEL 


A  differential  gaae  problea  using  a  realistic  aircraft  model  was 
discussed  in  Chapter  II.  The  purpose  of  this  chapter  is  to  obtain 
open-loop  solutions  to  this  differential  gaae  problea  using  the 
necessary  conditions  given  in  Chapter  III. 

Stateaent  of  the  Problea 

The  problea  is  to  determine  a  saddle  point  of 

J  (t  )  ■  R(t  J  »  [(x  -  x  )2  +  (h  -  h  )V/2 
f  *  ®  P  ®  P  t«tf 

subject  to 


x  »  V 
p  *P 


h  *  vw 

P  1»P 


• 

V 

•  D 

f(C_  -  k  c  2) 

COS  T  -  C 

xp 

P 

Tp 

P  1*P 

P  Lp 

• 

V 

«  D 

f(C_  -  k  C  2) 

sin  y  *  C 

bP 

P 

Tp 

p  Lp 

p  Lp 

P 

V 


(ID 


x  -  V 
e  xe 


he 


V  « 

D 

[(C 

-  k 

c  2) 

COS  T 

-  C 

xe 

e 

TO 

e 

Le 

e 

Le 

V  « 

D 

C(c 

-  k 

c  2) 

sin  y 

♦  Cr 

he 

e 

To 

e 

Le 

e 

Le 

(12) 


*  u 


where 


y  -  tan  (V  /V  ) 
P  hp  xp 


£ 
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v 

'e 


tan'1  (V.  /V  ) 
he  xe 


and  the  subscripts  p  and  e  refer  to  the  pursuer  and  wetor,  reap ac¬ 
tively.  The  final  tiee  (tf)  as  well  as  the  initial  uMlues  at  the  state 
variables  are  to  be  considered  specified.  and  are  tlie  controls 
tor  the  pursuer  and  evader,  respectively.  They  are  boeeded  by 

c,  .  <  c,  <  c, 

Lp  am  “  bp  -  Lp  nax 

(13) 

c.  .  <  c  <  c 

Le  mm  —  Le  ~  Le  max 


For  convenience  D  and  0  are  substituted  for  (Q  S/e)  and  (Q  9/e)  . 

P  e  P  e 

Up ,  0g  are  positive  constants. 

Necessary  Conditions 

Applying  necessary  conditions  for  a  saddle  paint  solution,  the 
Hamiltonian  is 

H  *  \  V  *  X,  V  ♦  X„  D  |(C  -  k  C,  2)  cos 

xe  xe  he  he  Vxe  e  11  Te  e  to  «• 

-  CU  sin  V  *  Ve  “e  l(CT.  •  k.  CJ)  fin  T. 

*  CU  “5  V  ’  *».  C  *  %  V  V 


^P 

-  k  C  2)  cos  y 

’  c. 

p  Lp  P 

if 

:Tp 

-  k  C  2)  sin  y 

♦  C 

P  Lp  p 

LP 

P 

V 


Vhp 


The  Hamiltonian  is  to  be  ninieized  with  respect  to  C. 

4> 

maximized  with  respect  to  C  subject  to  the  constraints  given  by 

Le 

Eq  (13).  If  the  minimizing  and  maximizing  controls  are  on  the  interior 
of  their  admissible  sets,  it  is  necessary  that 
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The  control  C  that  maximizes  H  subject  to  bq  (13)  is 
Le 


* 

C  « 
Le 


Le  max 


Le 


Le  min 


C  >  C, 

Le  Le  max 


C  .  <  <T,  <  C, 

Le  min  ~  Le  —  Le  max 


C  <  C 
Le  Le  min 


(16) 


The  Euler-Lagrange  or  costate  equations  are 


A  »  0 
xe 


X  *  0 
he 


A„  »  -A  -  A  0  ((C  -  k  C,  )  3 (cos  Y  )/»V 

Vxe  xe  Vxe  «  Te  e  e  xe 


-C  3(5in  Y  )/aV  1  -  AD  f(C 
Le  e  xe  Vhe  e  Te 


(17) 


k  C,  )  3 (sin  y  )/3V  ♦  C.  3 (cos  y  )/3V  ] 


Le 


e  xe  Le 


e  xe 


X  *  -A  -  A  D  f  (C  -  k  C  )  3  (cos  Y  )/W 
Vhe  he  Vxe  e  Te  e  Le  e  he 


-C  3 (sin  Y  )/*V.J  -  A  D  ((C 
Le  e  he  vhe  •  Te 


-k  C  *)  3 (sin  y  )/»V^  ♦  C  3 (cos  y  )/3V  ) 
e  Le  e  he  Le  e  he 


unore 


3 (cos  Y  )/3V  «  Sin2  y  /[V  2  ♦  Vv  V/2 

e  xe  e  xe  he 

?  2  1/2 

3 (sin  v  )/3V  «  -  sin  y  cos  y  /(V  ♦  V  J  , 

e  xe  e  e  xe  he 

3 (cos  y  )/3V  «  -  sin  y  cos  y  /IV  2  ♦  V  2)1/2 

e  he  e  e  xe  he 

3 (sin  y  )/3V  -  cos2  y  /IV  2  ♦  V.  2)l/2 

e  he  e  xe  he 


(18) 


<> 
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x  « o 
xp 

x  « o 
hp 

X  -  -x  -  X  D  [(C  •  k  C,  2)  9 (cos  r  )/3V 

Vxp  xp  Vxp  p  Tp  p  LP  p  xp 

“C  3 (sin  y  )/3V  ]  -  X  D  ((C 

Lp  p  xp  Vhp  p  Tp 

-k  C  2)  9 (sin  y  )/3 V  ♦  C,  3 (cos  Y  )/9V  J 

p  Lp  p  xp  Lp  p  xp 

X  ^  «  -X  -  X  D  ((C  -  k  C  2)  9(cos  y  )/»V 

Vhp  hp  Vxp  p  Tp  p  Lp  p  hp 

-C  3 (sin  Y  )/9V  J  -  X  D  C(C 

Lp  p  hp  Vhp  P  Tp 

-k  C  2)  9  (sin  Y_)/<*V  ♦  C  3  (cos  Y  )/9V.  J 

p  Lp^  P  hp  Lp  p  np 

where  the  partial  derivatives  are  defined  as  in  Eq  (18)  with  the 
subscript  e  replaced  by  p. 

T 

Hie  transversal ity  conditions  defined  by  x  (t  )  *  R  are 

"  f  ^ 

l„  'V  •  v  (V  •  <\  -  V/R  ‘t  -  «f 

<V  ■  -Ahp  <V  ■  <ho  -  V*  't .  tf 

\»  <V  • 0 


(19) 


(20) 


V.  lV  • 0 


Vxp 


«**> 


Vp  «**>  • 


Probleg  Solution 

The  problea  stated  above  is  a  two-point  boundary  value  p rob lea 
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(TPBVP).  Because  of  the  non-linearity  of  the  problem,  no  closed 
form  solution  is  known.  Open-loop  solutions  can  be  obtained  only 
through  the  use  of  numerical  iterative  techniques. 

Trajectories  satisfying  the  necessary  conditions  for  a  saddle 
point  solution  to  this  problem  may  be  generated  by  assuming  terminal 
■;tute  conditions 

x  ft  J  ■  x 

—  f  — t 

f 

and  simultaneously  integrating  backwards  in  time  the  state  differential 
equations  given  by  Eqs  (11)  and  (12)  and  the  costate  differencial 

equations  given  by  Eqs  (17)  and  (19)  with  conditions  at  tf  given  by 

#  * 

£q  (20).  The  saddle  point  controls,  and  Cj^  are  given  by  Eqs  (14) 

and  (15).  These  trajectories  represent  open-loop  solutions  to  the 

differential  game  problem  where  the  specified  initial  state  conditions 

x  (t  )  correspond  to  a  point  x  (t)  on  these  trajectories  and  the  fixed 
o  ~ 

flight  time  of  the  game  is  equal  to  -  t. 

Figures  4  and  5  show  two  solutions  obtained  in  this  manner.  The 
data  used  to  obtain  the  solution  shown  in  Figure  4  is 


xe  (tf)  s  33383  feet 


<V  • 


28262  feet 


he  (tf)  *  18808  feet 


h  (t^)  *  27278  feet 


V 

(t J  a  603  ft/sec 

V 

(t,)  -  740  ft/sec 

xe 

f 

*P 

f 

Vhe 

(tf)  »  -996  ft/sec 

Vhp 

(tj)  »  -1224  ft/ sec 

D 

*  122  ft/sec2 

D 

*  192  ft/ sec2 

e 

P 

C 

s  .06 

C 

»  .04 

Te 

To 
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Figure  S.  Optimal  Pursuit-Evasion  Trajectories  -  Standard 

Aircraft  Model 
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I 


k  «  .5  . 

k  «  .S 

e 

P 

I  C  |  <  1 

'Vil 

'  Le  '  ~ 

The  trajectories  in  Figure  4  can  be  viewed  as  the  solution  to  the 

differential  game  problem  where  the  initial  position  of  the  pursuer 

is  above  and  behind  the  evader. 

The  data  used  to  obtain  the  solution  shown  ir.  Figure  5  is 

x  (t J  *  35000  feet 
e  f 

x  (t  J  *  32000  feet 

P  f 

h  (t  )  -  30000  feet 

h  (t  )  «  25000  feet 

e  f 

P  ■* 

Vxe  *  688  ft/sec 

V  (tj)  ■  727  ft/sec 

(tf)  -  580  ft/sec 

V  (t  )  »  612  ft/sec 
hp  f 

0  *  160  ft/sec2 

0  »  175  ft/sec2 

e 

♦ 

P 

CL  «  .06 

C*  «  .04 

Te 

Tp 

k  *  .5 

k  »  .5 

e 

P 

|culil 

'Vs1 

In  the  differential  game  problem  corresponding  to  this  solution,  the 
pursuer  is  initially  behind  and  below  the  evader. 

These  solutions  will  be  used  as  a  comparative  base  for  the 
solutions  obtained  using  the  simplified  aircraft  models  which  are 
analyzed  in  the  next  three  chapters. 


I 


I 
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V.  PURSUIT-EVASION  DIFFERENTIAL  GAME  -  STATIC  MODEL 

In  Chapter  II,  the  pursuit-evasion  differential  game  problem 
..'as  cast  in  terms  of  the  acceleration  vectograa  associated  with  the 
aircraft  model.  The  difficulty  in  solving  the  differential  game  with 
the  standard  aircraft  model  resulted  from  the  parabolic  shape  of  the 
vectogram  and  its  orientation  with  respect  to  the  changing  aircraft 
flight  path  direction. 

In  this  chapter  the  problem  is  simplified  by  assuming  that  the 
orientation  of  the  vectogram  and  the  aircraft  flight  path  direction 
ar<  fixed.  This  is  equivalent  to  a  static  aircraft  analysis  with  a 
constant  flight  path  angle.  The  acceleration  vectogram  for  this  model 
is  the  same  as  Figure  3,  except  that  the  flight  path  inclination  angle 
.s  fixed. 

The  purpose  of  this  chapter  is  to  solve  the  pursuit -evasion 
differential  game  problem  with  the  static  virereft  model  and  to  discuss 
the  application  of  the  resulting  closed-loop  control  law  to  the 
standard  aircraft  model. 


Statement  of  the  Problem 

The  problem  is  to  determine  a  saddle  point  of 

J  (t  )  -  R  (t  )  »  {(xa  -  x  )2  ♦  (h  -  h  )2J l'2 
*  f  e  P  •  P  t»t„ 


subject  to 


x  r  V 
P  xp 


h  »  V 
P  h? 


(21) 


V  =  D  {(C  -  k  C  n  cos  C  -  C  sin  Cj 

xp  P  Tp  p  Lp  Lp 
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t 


D  {(C_  -  k  C,  )  sin  C  ♦  C,  cos  £]  -  G 


hp  p  Tp  p  Lp 


Lp 


xe 


he 


Vx.  ■  1<CT,  -  k.  Cu  >  <:°1  *  -  CL,  Si"  *1 


V.  *  0  t(CT  -  k  C,  '  )  lia  *  ♦  C,  COS  v]  -  c 
he  e  Te  e  Le  Le 


(22) 


where  the  subscripts  p  and  e  refer  to  the  pursuer  and  evader,  respec¬ 
tively.  5  is  *-he  specified  constant  flight  path  angle  for  the  pursuer 
and  ^  is  the  specified  constant  flight  path  angle  for  the  evader.  The 
final  time  (t^)  as  well  as  the  initial  values  of  the  state  variables 

are  to  be  considered  specified.  C  and  C  are  the  control  variables 

Lp  Le 

for  the  pursuer  and  evader,  respectively.  They  are  bounded  by 


C  <  C  <  C 

Lp  min  —  Lp  —  Lp  max 


C,  .  <  C,  <  C. 

Le  min  —  Le  —  Le  max 


(23) 


0  ,  C  ,  D  ,  C  are  positive  constants  defined  as  in  Chapter  IV. 
p  Tp  e  Te 


Necessary  Conditions 

Applying  necessary  conditions  for  a  saddle  point  solution,  the 
Hamiltonian  is 

H  »  X  V  ♦  X  V,  ♦  X  D  [TC  -  k  C  2)  cos  ♦ 
xe  xe  he  he  Vxe  e  Te  e  Le 

*  CiJ.  sin  *1  *  xvu  D.  *(Ct«  '  k  CiJ.2)  sin  * 

Le  Vhe  e  Te  e  Le 


♦  C  cos  v]  -  X  H  ♦  X  V  ♦  X^  Vv  ♦ 
Le  Vhe  xp  xp  hp  hp 
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D  l(C  -  k  C  *)  cos  C  -  C  sin  C] 
Vxp  p  Tp  p  Lp  Lp 


♦  X  0  ((C  -  k  C  z)  sin  5  ♦  C  cos  -  X 


Vhp  p  Yp  p  Lp 


Lp 


Vhp 


The  Hamiltonian  is  to  be  minimized  with  respect  to  C  and  maximized 

Lp 

with  respect  to  C  subject  to  the  constraints  given  by  Eq  (23).  If 
Le 

the  minimizing  and  maximizing  controls  are  on  the  interior  of  their 
admissible  sets,  it  is  necessary  that 


3H/3C  »  0 

Lp 


3H/3C  «  0 

Le 


and 


32H/3C,  2  >  0 
Lp  ~ 


32H/3C  2  <  0 
Le  — 


Solving  3H/3C  *  0,  one  obtains 

up 


C  *  tan  (0  -  0/(2k  ) 

Lp  p  p 


(24) 


where 


0  =  tan"1  (X  /X  ) 

p  Vhp  Vxp 


(25) 


Similarly  for  the  evader,  3H/3C  «  0  yields 

Le 


C.  «  tan  (0  -  ♦)/ (2k  ) 
*•«  e  e 


(26) 


where 


0  =  tan  (X  fX  ) 

e  Vhs  Vxe 


(27) 


C  and  C  are  minimizing  and  maximizing  controls  respectively, 
Lp  Le 

provided  that 

2  ? 

3  H/3C  '  «  -  2k  D  [sin  £  Xtft  ♦  cos  (  X,  ]  >  0 
Lp  p  P  Vhp  VxpJ  - 


and 
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2  2 

i  H/3C  ■  -  2k  D  {sin  $  X  ♦cos  *  A  ]  <  0 
le  e  «  Vhe  Vxe  ~ 

* 

The  control  C  that  ainiaizes  H  subject  to  Eq  (23)  is 


c 

Lp  aax 

C  >  C. 

Lp  Lp  aax 

CLp 

C  <  C  <  C 

Lp  ain  ~  Lp  -  Lp  aax 

(28) 

**Lp  ain 

C  <  C 

Lp  ~  Lp  ain 

that  aaxiaizes  H  subject  to  Eq  (23)  is 

C 

Le  aax 

C  >  C 

Le  Le  aax 

S., 

C,  .  <  Ct  <  C. 

Le  am  —  Le  —  Le  aax 

(29) 

c 

Le  ain 

C  <C. 

Le  Le  ain 

The  ccstate  equations  are 


X  «  0 
xe 


X  «  0 
he 


XVxe  *xe 


X  «  -  X 
Vhe  he 


X  «  0 

*P 

X  «  ° 

hp 

• 

X  »  -  X 
VxP  xp 


XVho  Xhr 
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30 


— *  * *-»  —  *  — 


(h  -  h  )/(x  -  X  )  I 
•  pep 

Comparing  these  equations  with  Eqs  (25)  and  (27)  shows  that 

0  (t)  »  0  (t)  «  0  (t  ) 

e  p  f 

where  0  is  the  angle,  measured  from  the  horizontal  to  the  line  of  sight 

between  the  pursuer  and  evader  at  termination.  Since  0  and  0  are 

*  *  .  #  P 

constant  functions,  the  controls  C  and  C  are  constants  from  Eqs 

Lp  Le 

(24),  (26),  (28)  and  (29). 

•  • 

Integrating  the  state  equations  V  and  and  combining  the 
results  yields 

V  (t)  '  ''  W  -V  (t  )  -  V  (t  ) 

xe  xp  xe  o  xp  o  (31) 

♦  {D  ((C  -  k  C*  2)  cos  if  -  C*  sin  *]  -  D  £ (C 

e  Te  e  Lc  Le  p  Tp 

-  k  C*  2)  cos  t  -  Ct  sin  C]}(t  -  t  ) 
p  Lp  Lp  o 

Integrating  Eq  (31)  yields 

x  (t)  -  x  (t)  «  x  (t  )  -  x  (t  )  ♦  [V  (t  )  -  V  (t  )]  (t  -  t  ) 

e  p  eopo  xe  o  xp  o  o 

♦  (D  £(C  -  k  C*  2)  cos  6  -  C*  sin  ♦]  (32) 

e  Tc  e  Le  Le 

-  D  ((C  -  k  C*  2)  cos  5  -  C*  sin  Cj>(t  -  t  )2/ 

p  &p  p  Lp  Lp  O  2 

The  following  equation  is  similarly  obtained  for  the  h  components  of 
the  state  equations 

h  (t)  -  h  (t)  •  h  (t  )  -  h  (t  )  ♦  [V  (t  )  -  V  (t  ))(t  -  t  ) 

e  p  eopo  he  o  hp  o  o 


♦  (D  ((C  -  k  C  )  sin  *  ♦  C.  cos  ♦]  (33 

e  Te  e  Le  Le 

-  0  t(C_  -  k  C  2)  sin  S  ♦  C  cos  5]}(t  -  t  )2/ 
p  Tp  p  Lp  Lp  o  2 
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Dividing  Eq  (33)  by  Eq  (32)  and  evaluating  at  t  ■  t  yields 


tan  0 


l 


h  (t  )  -  h  (t  )  ♦  [V  (t  )  -  V  (t  )](t  _  -  t  ) 
eo  Po  heo  hp  o  f  o 

* 


♦  (D  C(C  -  k  C  /)  sin  *  ♦  C  cos  *] 
e  Te  e  Le  w 

*  2 


D  ( (C  -  k  C,  ‘)  sin  5 
p  Tp  p  Lp 


♦  C*  cos  C] > (t  -  t  )2/ 
LP  f  o 


MV  (t  ) 
xe  o 


*P 


2 

(t  )](t 


]/(■. 


(t  )  -  x  (t  ) 
O  P  o 


(34) 


t  ) 
o 


♦  (D  [(C  -  k  C*  2)  cos 

e  Te  e  Le 

*  2. 


CLe  Sin  *] 


°P  I(CTP  '  Kp  C°S  5  '  %  Sin 


■  V%j 


Eq  (34)  is  a  transcendental  equation  with  the  unknown  parameter  0 
*  • 

since  C  and  CLe  are  functions  of  8  only  and  all  state  components 

are  specified  at  t  .  This  equation  can  be  solved  for  8  using  a 
o 

*  * 

digital  computer.  The  determination  of  8  allows  C.  and  C.  to  be 

Lp  Le 

computed  and  therefore  effectively  completes  the  solution  to  this 
differential  game  problem.  The  ability  to  continuously  determine  the 
optimal  controls  as  a  function  of  the  present  state  of  the  problem  and 
the  time  to  go  constitutes  a  closed-loop  control  law  for  this  differ¬ 
ential  game  problem. 


P s eudo-Dynamic  Application 

The  differential  game  problem  solved  in  this  chapter  is  based  on 
a  fixed  orientation  of  the  aircraft  flight  path.  A  possible  applica¬ 
tion  of  this  solution  to  the  standard  model  problem  of  the  previous 
chapter  would  be  to  solve  the  static  problem  at  each  integration  or 
specified  time  step  as  if  the  flight  path  angles  of  the  aircraft  were 


*4> 
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to  remain  fixed.  After  deteraining  the  controls  C  and  C  in  this 

Lp  Le 

manner,  they  would  be  applied  to  the  standard  model  dynamics.  This 
procedure  would  be  a  closed-loop  control  law  for  the  standard  model 
problem.  Results  of  the  application  of  this  procedure  are  presented 
in  Chapter  VIII. 


DS/MC/67-1 


VI.  PURSUIT-EVASION  DIFFERENTIAL  GAME  -  ZERO  INDUCED  DRAG  MODEL 

In  this  chapter  another  aircraft  model  is  considered.  This  model 

is  characterized  by  the  simplification  of  neglecting  drag  due  to  lift 

(induced  drag) .  This  simplification  is  accomplished  mathematically 

by  assigning  the  value  zero  to  the  induced  drag  factors  k  and  k  in 

P  « 

Eqs  (11)  and  (12).  A  further  simplification  is  introduced  by  neglect¬ 
ing  gravitational  forces.  The  improvement  of  this  model  over  the 
static  model  is  that  the  flight  path  orientation  is  not  fixed  Cy  ji  C). 
The  acceleration  vectogram  representing  this  model  is  shown  in  Figure 
6  and  is  termed  the  zero  induced  drag  model. 


Figure  6.  Acceleration  Vectogram  for  the  Zero  Induced  Drag  Aircraft 

Model 
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Chapter  IV.  C  and  C  are  the  controls  for  the  pursuer  and  evader, 

Lp  Lv 


respectively.  They  are  bounded  by 

C,  <  C,  <  C. 

Lp  nun  -  Lp  -  Lp  max 


C,  .  <  C.  <  C, 

Le  nun  -  Le  -  Le  max 


Analysis  of  this  problem  is  made  easier  if  the  state  variables  Vx  and 

Vh  are  replaced  by  V  and  y  where 
2  2i/2 


V  =  [V  ♦  V  1 
x  h  1 


and  y  *  tan"1  (V./V  ) 

n  x 


The  resulting  state  equations  are 

x  a  V  cos  y 
P  P  p 


h  =  V  sin  y 
P  P  P 


V  •  D  C 
P  P  Tp 


(37) 


Y  -  D  C,  /V 
P  P  Lp  p 


x  »  V  cos  y 
e  e  « 


h  »  V  sin  y 

e  e  e 


V  »  D  C. 


e  Te 


(38) 


Y  *  D  C.  /V 
e  e  Le  e 


►'hi cl.  replace  Eqs  (35)  and  (36). 


Accessary  Conditions 

Applying  necessary  conditions  for  a  saddle  point  solution,  the 
Hamiltonian  is 
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H  *  A  V  cos  y  ♦  x  v  .{ 

"  *  *  h»  • sl" Y.  *  V. ».  s. 

“l/eV,*1  V  si„Y 

P  hp  p  T 


+  A  D  c_  ♦ 
Vp  p 

The  costate  equations  are 


v<-  » S  *  DP  w 


A  »  0 
*P 

A  »  o 

hp 


At/B  *  “  A  cos  y  -  x 

p  *  p  »p  YP  *  »p  VV 


\n  *  V  (x  sin  Y  .  A 
p  p  xp  T  A 


,  COS  Y  ) 

P  hp  V 


A  »o 
xe 


A  »  o 

he 


~  A  cos 
xe 


Ye  '  Ahe  Sin  T  ♦  A  D  c  /V  2 

e  ve  e  Le'  e 


\e  *  v  (A  sin  Y 
'  v  xe 


The 


«  ’  \t  C°S  V 
transversal ity  conditions  yieid 


A  (t  J  «  - 
xe  f 

AXP  (V  *  Cx  -  X  )/R  f 

e  P  t»tf 

A 

he 

cv  -  - 

"hp  (V  *  (he  -  h '  >/*  L 

ft  *  p  't«t 

Ve 

(t^  •  o 

f 

A 

Y« 

ft 

"L, 

« 

o 

X 

(t^  «  0 
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(t  )  «  0 


Minimizing  the  Hamiltonian  with  respect  to  C  and  maximizing  with 
respect  to  C  subject  to  the  constraints  on  C  and  C  defines  the 


Le 


controls 


Le 


Le  max 


Le  min 


Lp 


S  >  0 
e 


S  <  0 

e 


(39) 


'Lp 


Lp  max 


'Lp  min 


S  <  0 
P 

S  >  0 
p 


where 


S  =  3H/3C 
e  Le 


X  0  /V 
Ye  «  e 


S  =  3H/3C  =  X  D  /V 

p  Lp  Yp  p  p 


However,  if  S  is  equal  to  zero,  the  Hamiltonian  is  independent 
e 

uf  C  and  it  is  not  possible  to  maximize  H  with  respect  to  C  . 

Le  Le 

Similarly  for  5  equal  to  zero,  H  cannot  be  minimized  with  respect 
P 

to  C  .  If  S  or  S  are  zero  over  a  non-zero  time  interval,  a 
Lp  e  p 

singular  control  in  C  or  C  may  occur.  Necessary  conditions  for 

Le  Lp 

the  existence  of  singular  solutions  were  presented  in  Chapter  III. 

For  a  singular  control  in  C  it  is  necessary  that  S  and  all  its 

Lp  p 

time  derivatives  vanish.  Similarly,  for  a  singular  control  in  C  , 

Le 

is  necessary  that  S  and  all  time  derivatives  of  S  vanish.  These 
e  e 

conditions  are  now  examined  to  determine  if  singular  solutions  exist 
for  thi.  problem. 
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Setting  S  «  0  yields 
P 

S  -  X  D  /V  »  0 
P  YP  p  P 

which  ioplies  that  X  ■  0 

YP 

Setting  5^  «  0  yields 

S  «  D  (X  /V  -  X  V  /V  2]  -  0 
P  p  YP  P  Yp  P  P 

•  * 
which  implies  P  X  /V  *  0  since  X  *  0.  Substituting  for  X  , 
V  Yp  p  Yp  *  Yp 

D  (X  sin  y  -  X  cos  y  ]  »  0 

P  *p  p  hp  p 

which  implies  that  tan  y  •  X  /X  along  a  singular  arc 

p  hP  *P 

Setting  S  ■  0  yields 
P 

5  «  D  y  [X  cos  Y  ♦  X  sin  y  ] 

P  P  P  *P  p  hp  p 

•  • 

♦  0  [X  sin  Y  -  X.  cos  y  j  *  0 
p  xp  p  hp  p 


D  y  IX  cos  y  ♦  X  sin  y  ]  *  0 

p  p  xp  P  hp  p 

D  2  C.  (X  cos  y  ♦  X  sin  y  J/V  »  0 
P  xp  p  hp  p  p 

•  « 

since  X  and  X.  are  zero  from  the  costate  differential  equations, 
xp  hp 

For  S  to  be  zero,  either  C  must,  be  zero  or 

p  Lp 

[X  cos  Y  ♦  X.  sin  y  )  *  0 
xp  p  hp  p 

Assuming  (X  cos  y  ♦  X  sin  y  ]  equals  zero  implies  that  tan  y  * 
xp  p  hp  p  p 

-  X  /X  along  a  singular  arc.  This  is  in  contradiction  with  the 
xp  hp 

result  of  Eq  (40).  It  is  concluded  that  along  a  singular  arc  the 
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singular  control  C  is  equal  to  zero.  A  necessary  condition  for  the 
Lps 

optimality  of  this  solution  is  that 


-3  S  /3C  >  0 

P  hp  - 

Application  of  this  condition  gives 

-S  /3C  »  -[X  cos  v  ♦  XL  sin  y  J  (D  2/V  ) 

p  Lp  xp  p  hp  P  P  P 


(41) 


(42) 


To  show  when  this  necessary  condition  holds,  transversality  conditions 
require 

X  (t  J  =»  -(X  -  x  )/R  I 
xp  f  e  p  t*t 


and 


>-  (« j  -  -  y/«  lt.t 


hp  f  «  k  --*•£ 

Defining  0  as  the  angle  measured  between  a  line  from  the  pursuer  to 
the  evader  and  the  horizontal  at  termination  A_  (t J  and  X. 

become 

x*n  (t  J  a  *  (t)  *  *  cos  ® 

xp  f  xp 


xp  and  ‘hp  (V 


V  <V  ’  V  (t)  ’  - !i”  • 

since  X  and  A.  are  constants.  Making  these  substitutions  in  Eq  (42) 
xp  hp 

gives 


-3S  /3C  =  cos  (0  -  y  ) 

p  Lp  p 


(43) 


Along  a  singular  arc  *  0  requires 

fx  sin  y  -  X  cos  y  J  »  sin  (C  -  y  )  *  0 
xp  p  hp  p  p 

which  implies  that  Yp  9  9  or  y^  •  0  ♦  r..  Substituting  Tp  *  ®  and 

Y  *  0  ♦  *  into  Eq  (43)  yields 
P 

-as  /ac,  *  l  >  o  fo?  y  *  ® 

p  Lp  p 
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l 


and 

-3  S  /3C  »  -1<  0  for  y  *  6  ♦  * 

P  Lp  P 

Therefore  the  necessary  condition  Eq  (41)  is  only  satisfied  when 

Y  •  0.  A  similar  analysis  for  the  evader  reveals  that  S  ■  0  over 
P  • 

a  non-zero  tine  interval  corresponds  to  a  singular  solution  with  the 

singular  control  C  «  0. 

The  optimal  controls  for  the  solution  to  this  differential  game 
problem  can  now  be  given  as 


S  /  0 
P 

S  »  0 
P 


S  /  0 
e 


S 

e 


0 


where  C.  and  C, 
Lp  Le 


are  given  by  Eqs  (39). 


(44) 


Problem  Solution 

In  an  optimal  solution  to  this  problem  there  are  three  choices 

of  control  depending  on  whether  S  and  S  are  greater  than,  equal  to, 

P  e 

or  less  than  zero.  In  order  to  construct  an  optimal  solution  to  this 

problem  the  allowable  "sequences  of  these  controls  must  be  determined. 

The  first  question  to  consider  is  whether  or  not  a  singular  arc 

can  be  followed  by  a  non-singular  arc  in  an  optimal  sequence  of 

controls.  To  answer  this  question  assume  that  the  pursuer  is  on  a 

singular  arc  and  applies  the  control  C  .  On  the  singular  arc 

Lp  max 
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the  following 

is  true. 

(1) 

Y 

*  0 

P 

(2) 

X 

*  0 

YP 

(3) 

X 

«  V 

YP  I 

From  Eqs  (37) 

one  sees 

P  P 


Lp  max 

causes  y  to  increase  so  that  y  >  0.  This  implies  that  X  <0  and 
P  P  YP 

that  X  also  becomes  negative.  In  order  to  satisfy  the  transversality 
YP 

condition  X  (t  J  «  0  the  sign  of  X  must  somewhere  become  positive. 
Yp  T  YP 

This  will  happen  when  y  *  -0.  Physically  this  means  that  the  flight 

P 

direction  of  the  pursuer,  when  X  *  0,  is  in  the  opposite  direction 

YP 

of  the  line  of  sight  between  the  pursuer  and  evader  at  termination. 

At  this  point  the  transversality  condition  X^  (t^)  »  0  still  has  not 

been  satisfied  since  X  <0.  This  implies  continued  application  of 

YP 

the  control  C  which  causes  further  rotation  of  the  flight  path 

Lp  max 

direction  of  the  pursuer  until  X  *  0.  If  at  this  point  X  *  0, 

Yp  YP 

the  pursuer  will  again  be  on  a  singular  arc  with  y  •  0.  This  means 

P 

that  the  pursuer  has  literally  traveled  a  circular  trajectory  which 

obviously  cannot  be  an  optimal  pursuit  trajectory. 

If  X  >0  when  X  *  0  the  following  control  sequence  must  be 
yP  YP 

considered 

<Ct  ,  C,  1 
Lp  max  Lp  min 


To  show  that  this  cannot  be  an  optimal  control  sequence,  assume  that 

X  <0  and  X  >0.  The  choice  of  control  corresponding  to  X  <  0 
Yp  YP  .  Tp 

is  C.  .  If  X  >0  when  X  »  0,  x  will  become  positive 
Lp  max  yp  YP  Yp 

resulting  in  switching  to  C  *  C,  .  Since  X  >  0,  y  must  be 

6  Lp  Lp  min  YP  P 
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less  than  0.  The  choice  of  C,  ,  will  cause  y  to  decrease  and  X 

Lp  ain  p  Yp 

will  remain  positive  causing  X  to  become  more  positive.  Again  the 

yp 

pursuer  will  be  traveling  in  a  circle  which  physically  cannot  be  an 
optimal  pursuit  trajectory.  By  symmetry,  (C^  ^n,  C  cannot  be 

an  optiaal  control  sequence. 

It  is  concluded  that  in  an  optiaal  sequence  of  controls  a  singular 

arc  cannot  be  followed  by  a  non-singular  arc.  Therefore  if  the  pursuer 

is  on  a  singular  arc,  he  reaains  on  the  singular  arc. 

Having  eliainated  {C,  .  C.  },  {C.  .  ,  C,  },  and  the 

*  Lp  aax'  Lp  ain  Lp  ain  Lp  aax 

transition  from  a  singular  to  a  non-singular  arc  as  optiaal  control 

sequences,  there  are  three  control  sequences  possible  in  an  optiaal 

solution  to  this  problea.  These  are 

{c.  or  c,  ,  »  ®>  J  <c,  or  C  >  ;  {0} 

Lp  max  Lp  axn  Lp  aax  Lp  ain 

A  physical  interpretation  of  the  use  of  these  control  sequences  can  be 
made  by  an  analysis  similar  to  that  used  to  show  that  a  switch  from  a 
singular  arc  to  a  non-singular  arc  cannot  be  made.  Consider  an  initial 
value  of  y  <0.  This  implies  that 

P 

X  •  V  sin  (6  -  y  )  >  0 
YP  p  p 

To  satisfy  the  transversal ity  condition  A  (t  )  «  0,  X  must  be 

Yp  f  Yp 

negative  for  which  the  choice  of  C  «  C  is  the  optiaal  control. 

Lp  Lp  max 

The  control  C  ***  rotates  the  flight  path  direction  of  the  pursuer 
toward  0.  When  y  *  0,  the  pursuer  switches  to  the  singular  control 
C.  *  0.  For  an  initial  value  of  v  >9,  the  optiaal  control  is 
C  ain  an<*  t^ie  path  direction  of  the  pursuer  is  again  rotated 

toward  the  direction  9.  Similar  arguments  and  statements  can  be  aade 
in  regard  to  the  optiaal  control  sequences  for  the  evader. 
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The  main  point  of  this  discussion  is  that  the  optimal  solution  to 

this  problem  involves  the  employment  of  maximum  or  minima  control  to 

to  rotate  the  velocity  vector  of  each  vehicle  into  a  prescribed 

*  * 

direction  after  which  a  singular  C  ■  0  or  C,  «  0  is  the  optimal 

«P  L®  r 

control.  The  trajectories  of  the  pursuer  and  evader  are  characterized 
by  a  hard  turn  followed  by  a  non-turning  arc.  The  condition  when  both 


aircraft  are  on  singular  arcs  occurs  when  the  flight  path  directions 
of  the  two  aircraft  are  colinear.  This  can  be  shown  as  follows. 

On  the  singular  arc,  the  state  equations  reduce  to 


X 

s 

V 

cos  0 

X 

* 

V 

cos  0 

p 

p 

e 

e 

h 

St 

V 

sin  0 

• 

h 

S 

V 

sin  0 

P 

p 

e 

e 

V 

— 

D 

c 

• 

V 

m 

D 

c 

P 

P 

Tp 

e 

e 

Te 

Y 

c 

0 

• 

Y_ 

0 

P  e 


•  • 

Integrating  x  and  h  yields 

P  p 

x  (t  J  *  x  (t)  ♦  cos 

p  r  p 

h  (t  )  =  h  (t)  ♦  sin 
p  f  p 

nnd  similarly  for  the  evader 

x  (t  J  ax  (t)  ♦  COS 
e  f  e 

(t^)  a  he  (t)  ♦  sin 

Dividing  [h  (t  )  -  h  (t.)J  by 
e  r  p  r 


o  r  v  dt 
t  p 

®  }f  v  dt 
t  p 


tr 

o  /  v  dt 

t  e 
tf 

0  J  V  dt 

t  • 

(*e  (tjP  -  (tf)]  yields 
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tan  0 


t- 

(t)  ♦  sin  0  Jr  V#  dt  -  hp  (t)  -  sin  0  Jx  Vp  dt 

—  — 

x#  (t)  *  cos  0  /  Ve  dt  -  xp  (t)  -  cos  0  Jr  Vp  dt 


which  is  equivalent  to 

tan  0  -  fh  (t)  -  h  (tjJ/Cx^  (t)  -  x  (t)J  (4S) 

e  P  •  p 

This  implies  that  the  line  of  sight  direction  between  the  vehicles  is 
a  constant  and  equal  to  the  terminal  line  of  sight  direction  when  both 
vehicles  are  on  singular  arcs.  This  proves  that  the  flight  path 
directions  of  both  aircraft  are  colinear  under  these  conditions. 

Because  of  the  special  conditions  associated  with  the  singular 
arc  solutions,  initial  conditions  generally  require  the  initial  enploy- 
ment  of  Maximum  or  Minima  control.  The  closed- loop  solution  to  a 
general  problem  can  be  constructed  as  follows: 

(1)  For  the  evader,  choose  the  control  C,  or  C, 

Le  Max  Le  Min 

that  causes  the  evader  to  rotate  its  velocity  vector 
away  froa  the  pursuer.  Holding  this  choice  of  control 
constant,  integrate  a  turning  trajectory  for  the  evader. 

(2)  For  the  pursuer,  choose  the  control  C,  or  C, 

Lp  Max  Lp  min 

that  causes  the  pursuer  to  turn  in  the  direction 
necessary  to  achieve  a  tail  chase  condition.  Holding 
this  choice  of  control  constant,  integrate  a  turning 
trajectory  for  the  pursuer. 

(3)  The  points  of  tangency  between  the  two  trajectories 
identify  the  switching  points  for  each  aircraft.  The 
slope  of  a  line  drawn  between  these  two  points  identifies 
the  final  line  of  sight  direction  0.  The  geonetry  of 
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this  solution  is  shown  in  Figure  7.  If  points  of 
tangency  do  not  exist  due  to  the  ability  of  the  evader 
to  turn  tighter  than  the  pursuer,  the  aircraft  does  not 
switch  from  the  turning  controls  to  the  singular 
controls.  The  hard  turn  controls  are  then  maintained 
over  the  complete  trajectory. 


Figure  7.  Switching  Point  Geometry  for  Zero  Induced  Drag  Control  Law 

This  is  an  open-loop  solution.  However,  it  can  be  provided  on  an 
instantaneous  and  continuous  basis  thereby  producing  a  closed-loop 
strategy.  It  is  interesting  to  note  that  even  though  the  problem 
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was  presented  as  a  fixed  time  problea,  the  saae  solution  applies  to 

the  ainiaua  tiae  intercept  problea. 

This  problea  was  fomulated  neglecting  gravitational  forces  since 

this  is  sufficient  to  prevent  the  synthesis  of  closed- loop  controls. 

However,  it  is  felt  that  this  problea  and  solution  is  of  value  since 

it  can  be  argued  that  gravity  effects  both  vehicles  alaost  equally 

providing  velocity  differences  are  not  too  great.  The  most  significant 

assumption  related  to  this  aodel  is  the  neglecting  of  induced  drag. 

Because  of  the  distinctive  two  arc  solution  of  this  problea,  a 

correction  for  induced  drag  can  very  easily  be  introduced.  This 

correction  consists  of  subtracting  froa  the  net  thrust  (T  and  T  ; 

e  p 

an  additional  drag  value  corresponding  to  that  noraally  induced  by 

the  value  of  C.  or  C.  .  This  additional  tern  would  be 
Lp  max  Le  max 

required  only  during  the  turning  portion  of  the  solution. 
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VII.  PURSUIT-EVASION  DIFFERENTIAL  GAME  -  LINEARIZED  DRAG  POLAR  MODEL 


In  the  previous  chapter  the  zero-induced  drag  model  was  introduced. 
It  was  pointed  out  how  the  drag  due  to  lift  or  induced  drag  could  be 
taken  into  account  in  that  solution  to  the  differential  game  problem. 

In  this  chapter,  the  aircraft  model  is  an  improvement  over  the  zero- 
induced  drag  model  in  that  drag  due  to  lift  is  considered  directly. 

The  difference  between  this  model  and  the  standard  aircraft  model  is 
the  choice  of  a  linearized  drag  polar  instead  of  the  parabolic  drag 
polar.  If  gravitational  forces  are  neglected,  a  closed-loop  control 
law  can  be  obtained  for  the  pursuit-evasion  differential  game  with  the 
linearized  drag  polar  model.  The  vectogrsm  for  this  model  is  shown  in 
Figure  8. 

The  purpose  of  this  chapter  is  to  solve  the  pursuit -evasion 
differential  game  with  the  linearized  drag  polar  aircraft  model. 


Statement  of  the  Problem 


The  problem  is  to  determine  a  saddle  point  of 

J  (t  J  *  R  (tj  -  [(x  -  x  )2  ♦  (h  -  hf]1/2 

r  r  •  p  «  p  t*t 


subject  to  the  state  equations 

x  *  V 
P  *P 


h  »  V 
P  hp 

V  *  D  [(C  -  k  |  C  |)  cos  y  -  C  sin  y  ] 

xp  t  Tp  p  Lp  p  bp  p 

V.  ■  D  J(C  -  k  j  C  J)  sin  y  ♦  C  cos  y  J 

hp  p  Tp  p  Lp  p  Lp  p 


(46) 
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Figure  8.  Acceleration  Vectograa  for  the  Linearized  Drag  Polar 

Aircraft  Model 


x  -  V 
e  xe 

h  >  V 

a  he 

’»  '  t(CT.  -  \  I  CU  '>  «’  %  -  Cu  V 
Vh.  *  ,(CT.  '  k.  1  CL.  11  >l"  %  *  Cu  «*  %> 


(47) 


where 
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Y  5  tan-1  (V  /V  ) 

P  1>P  *P 

Y  =  tan"1  (V  /V  ) 

c  he  xe 

and  the  subscripts  p  and  e  refer  to  the  pursuer  and  evader,  respec¬ 
tively.  The  final  tine  t.  as  well  as  the  initial  values  of  the  state 

variables  are  specified.  0  C  ,  0  and  C  are  constants  defined 

p  Tp  e  Te 

in  Chapter  IV.  C  and  C.  are  the  controls  and  are  constrained  by 
Le  Lp 

Cf  .  <  c,  <  c, 

Lp  Bin  -  Lp  —  Lp  aax 

C,  '  <  C.  <  C, 

Le  min  —  Le  —  Le  max 

The  constants  k  and  k  are  chosen  so  that  the  linearized  drag  polar 
p  e 

relationships  given  by 

CDe  ■  °D0e  *  k.  1  CL.  1 

CDp  *  CDOp  +  kp  ^  CLp  ^ 

represent  the  best  linear  approximation  to  the  parabolic  drag  polar 

relationships  given  in  Chapter  II.  As  in  the  last  chapter,  analysis 

of  this  problem  is  made  easier  if  the  state  variables  x,  h,  V  ,  and 

x 

are  replaced  by  V  and  y  where 


V  =«  [V  2  ♦  V  2] 1/2 
x  h 


and  y  *  tan‘J  (V  /V  ) 
h  x 


The  resulting  state  equations  are 

x  ■  V  cos  y 
P  P  P 

h  »  V  sin  y 
P  P  P 


V  »  D  (C  -  k  |  C  j] 
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| 


% 

I 

* 

5 

i 


k 


? 

i 


Y  •  0  C  /V 
P  P  Lp  p 


(49) 


x  *  V  cos  v 

•  3  y 

• 

i  »  V  sin  y 

a 

V  »  0  fc  -  k  I  C  ll 
e  e  1  Te  o  «  %  ” 

•  • 

Y-  »  D  C  /V 

•  t  U  ( 

«hich  replace  Eqs  (46)  and  (47). 


Necessary  Condition* 

Apply!.*  necessary  condition,  for  a  saddle  point  solution,  the 
Hamiltonian  is 

"  ■  *x.  v.  co*  %  ♦  \  »  sin  Y  ♦  A  D  fC  -tie  h 

*  h®  e  o-  Ve  e  1  Te  %  >  CLe  11 

*  »,  W.  *  vp  «•  »p  *  V  Vp  ,i„  Tp 

*  *vp  DP  icip  •  k,  1  %  11  ♦  \p  Dp 

The  costate  equations  are 

1  ■  0 
xp 


V° 


*Vp  "  '  Axp  cos  Y  -  x  Sin  Y  ♦  A  0  C  /V 
P  hp  P  Yp  p  Lp  p 


(50) 


\p  '  %  (‘rp  Sl”  ’p  -  \  »*  T) 


\  •  o 

x* 
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he 

-X 

cos  y 

-  XL 

sin  y 

♦  X 

Vc 

xe 

e 

he 

e 

.  c 

V  (X 

sin 

y  -  X 

cos 

Y  ) 

ye 

e 

xe 

e 

he 

e 

ye  e  Le  e 


(SI) 


The  transversal ity  conditions  yield 

*»  (V  '  -  »xp  'V  '  (Xe  '  V/R  lt-t) 

V  (V  ■  -  V  “f>  ■ (h.  -  y/R  U 


(tf>  *  0 


X  (t  )  =  0 
ye  £ 

(t  )  *  0 

Vp  f 

\p  ‘V  * 0 

It  is  necessary  that  the  Hamiltonian  be  minimized  with  respect 

to  C  and  maximized  with  respect  to  C  subject  to  the  constraints 
Lp  Le 

on  C  and  C  .  To  determine  the  C  that  minimizes  H,  consider  the 
Lp  Le  Lp 

terms  in  H  that  explicitly  contain  C  .  Defining  these  terms  as  H  , 

LP  p 


(S2) 


H  -  -  A  Ok  i  C  |  ♦  X  D  C  /V 
P  Vp  P  P  bp  Ip  P  IP  ? 


(53) 


If  C  >  0,  Eq  (S3)  can  be  written  as 
Lp 


_  ♦ 
H 


[-  X  k  D  ♦  X  D  /V  J  C 
Vp  p  p  ip  p  P  Lp 


and  for  C  <  0,  Eq  (53)  becomes 
Lp 

H  ‘  =  [X  k  D  ♦  A  D/VJC 
P  Vp  p  p  yp  p  P  Lp 
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Defining 


end 


M  5  [-  X  k  D  ♦  X  0  /V  ] 

f  Vp  p  p  y?  p  p' 


“  5  K  D«  ♦ x  D  /v  ] 

P  Vp  P  p  TP  p  p 


Eq  (SS)  can  be  written  es 


M  C 
p  Lp 

• 

9 

C,  >  0 
Lp 

H  • 

P  M  “  C, 

P  *-P 

« 

9 

Ct  <  0 
Lp 

To  determine  the  that  minimizes  and  thus  minimizes  H,  the 
following  figure  is  convenient. 


Figure  9.  Diagram  Showing 


it. 


f\C*  ; 

MO/  P!*j/  O  /  -  1 


The  minimum  of  H  with  respect  to  C  is 
P  Lp 

min  (0,  M  "  C  ,  M  *  C  ) 

p  Lp  min  p  Lp  max 

'f  the  minimum  of  H  is  M  *  C  ,  the  minimizing  control  is  C 

p  p  Lp  min  Lp  min 

If  the  minimum  H  is  M  C  ,  the  minimizing  control  is  C 

p  p  Lp  max  ^Lp  max 

If  the  minimum  IT  is  equal  to  zero,  the  minimizing  control  C  is  either 


Lp 


zero  or  is  a  singular  control. 


To  determine  the  C  that  maximizes  H  define 
Le 


*Ve  e 


0  k 


:  I  ♦  A  D  C  /V 

Le  Ye  e  Le  e 


Defining 


M  5  [-  JL.r,  k  ♦  A  D  /V  ] 

e  ve  e  e  re  «  e 


(57) 


and 


M  ‘  5  D  k  *  *  D  /y  1 
•  ve  e  e  ye  e  e  , 


(58) 


il  can  be  written  as 
e 


H 


M 

C, 

C 

>  o 

e 

Le 

Le 

M  ' 

C, 

C 

<  o 

e 

Le 

Le 

(59) 


The  maximum  H  with  respect  to  C  is 
e  Le 


max  {0,  M  C  ,  M  "  C  } 

e  Le  max  e  Le  min 


If  the  maximum  H  is  M  C,  ,  the  maximizing  control  is  C. 

e  e_  Le  max  *  Le  max 

If  the  maximum  H  is  M  C.  .  ,  Che  maximizing  control  is  C 

e  c  Le  min  *  Le  min 

If  the  maximum  h  is  zero,  the  maximizing  control  is  either  zero  or 
e 

is  a  singular  control. 
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Froblea  Solution 

It  is  shown  in  Appendix  B,  that  singular  controls  cannot  occur 
in  this  problem  and  that  an  optimal  solution  is  one  of  the  control 
sequences 


!Ct,  MX  "  %  .!»•  °>  •  (CLp 


or  C  )  ,  {0} 
Lp  sin 


The  switching  point  for  the  first  sequence  is  determined  by  integrating 

backwards  in  time  from  the  terminal  surface  the  state  and  costate 

differential  equations  assuming  the  control  C,  «  0 

Lp 

Along  the  C  «  0  arc,  the  state  equations  are 
• 

x  «  V  cos  y 
P  P  p 


h  ■  V  sin  y 
P  P  P 

V  «  D  C 
P  p  T*> 


y  »  0 

P 


and  the  costate  equations  are 


X 

»  0 

xp 

• 

X 

»  0 

hp 

X 

■  -  X  COS  Y  - 

x. 

VP 

xp  p 

hp 

• 

X 

■  V  (X  sin  y 

-  X 

YP 

P  *P  p 

1 

hp  P 

From  transversality  conditions  and  Eqs  (61) 

A  (t)  «  X  (t J  •  -  cos  0 
xp  xp  r 

X.  (t)  *  X  (t  )  «  -  sin  0 
hP  hp  ; 


(60) 


(61) 


(62) 


■<*  p 
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where  0  is  the  angle  measured  between  a  line  from  the  pursuer  to  the 
evader  and  the  horizontal  at  t  *  t^.  Substituting  Eqs  (62)  into  (61) 
gives 


(63) 

vP  * cos  (0  -  V 

X  -  V  sin  (0  -  Y  ) 

Yp  P  TP 

• 

Integrating  V  yields 
P 

V  (t)  -  V  (t J  -  D  C  (t  -  t)  •  (64) 

P  P  f  P  TP  * 

Integrating  xyp  yields 


Xv  (t)  *  -  cos  (0  -  Y  )  (t  -  t)  (65) 

VP  Tp  * 


where  \ 

Vp 


0  from  transversality  conditions. 


Integrating  \  yields 
YP 


X  (t  )  -  x  (t)  -  sin  (0  -  y  )  jf  V  (t)  dt 
YP  f  YP  P  t  P 

V  (t  J 

X  n  (t)  -  -  sin  (0  -  y  )  IP  r  V  (t)/(D  C_  )  dV 
YP  TP  ^  (t)  P  P  TP 

P 

*  -  sin  (0  ■  y  )  (V  2  (tj  -  V  2  (t) }/ (20  C  ) 
P  P  f  P  p  Tp 


(66) 


where  x  (t  }  *  0  from  transversality  conditions.  Substituting  Eq 

Yp  f 

(64)  into  (66), 

X  (t)  3  -  V  (t)  sin  (6  -  Y  )  (t  -  t)  {I  ♦  (6 7) 

YP  P  P  f 


<  •* 
%  f* 


-%  3? 
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D  ^  <**  "  «>/<*»  (*))> 
p  Tp  f  p 

Necessary  conditions  to  be  on  a  C,  »  0  arc  are 

Lp 

H  n  [-  X  k  ♦  X  A  ]  >  0  (68) 

Vp  p  YP  p 


or 

M*  »  [A  k  4  X  /V  ]  <  0  (69) 

Vp  p  Yp  p 

Substituting  Eqs  (65)  and  (67)  into  (68)  and  (69)  yields 

tan  (0  -  Y  )  <  k  /U  ♦  *>  C  (t-  -  t)/(2V  )) 
p  p  p  Tp  *  P 

tan  (0  -  Y  )  >  -  k  /Cl  ♦  D  C  (t  -  t)/(2V )) 

p  P  P  »p  f  p 

which  can  be  combined  to  give 

|  tan  (Q  -  y  )  I  <  k  /[i  ♦  D  C  (t  -  t)/(2V  )J  (70) 

P  P  p  Tp  f  p 

The  solution  to  a  general  problem  is  similar  to  the  solution 

obtained  in  the  last  chapter  in  that  it  is  characterized  by  a  hard  turn 

with  either  C  or  C  as  the  control  followed  by  a  non-turning 

Lp  max  Lp  min 

arc  or  dash.  The  principle  difference  between  this  solution  and  that 
of  Chapter  VI,  is  the  condition  under  which  switching  occurs.  In  the 
solution  to  this  problem  switching  to  the  non-turning  arc  occurs  for 
the  pursuer  when 

|  tan  (0  -  y  )  |  •  k  /[I  ♦  D  C  (t  -  t  )/(2V  )]  (71) 

P  p  p  Tp  f  ps  p 

and  for  the  evader  when 

|  tan  (Q  -  y  )  |  •  k  /[I  ♦  D  C  (t,  -  t  )/(2V  )]  (72) 

e  e  •  Te  f  es  s 

where  t  and  t  are  the  switching  times  for  the  pursuer  and  evader 
ps  es 

respectively,  and  6  must  satisfy 
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— - » •  •— f  • 


tan  0  »  {h  (t  )  -  h  (t  )  ♦  V  (t  )  (t  -  t  ) 
e  es  p  ps  he  es  *  »« 


es 


v  (t  )  (t,  -  t  )  ♦  D  C  sin  y  (t  )  (t  -  t  )  /„ 
hp  ps'  f  ps'  e  Te  e  es'  v  £  es'  2 


-  D  C  sin  Y  (t  )  ft  -  t  )V, >/(x  (t  ) 

p  Tp  p  ps  f  ps  2  e  es 

-  x  (t  )  ♦  V  (t  )  (t.  -  t  )  -  V  (t  )  (t  -  t  ) 

p  ps  xe  es  £  es  xp  ps  t  ps 

2 

v  D  C  cos  y  (t  )  (t  -  t  )  /, 

e  Te  e  es  f  es  2 


(73) 


-  D  C  cos  y  («  )  (t  -  t  )2/  > 
p  Tp  p  ps  f  ps  2 

To  show  this,  the  state  equations  given  by  Eqs  (46)  and  (47)  evaluated 

for  C  and  C  equal  to  zero  are 
Lp  Le 


X  a  V 
P  xp 


x  «  V 
e  xe 


h  «  V 
P  hp 


h  »  V 
e  he 


V 

= 

c 

COS 

Y 

V 

a  D 

C 

COS 

Y 

xp 

P 

Tp 

P 

xe 

e 

Te 

( 

• 

VL 

a  D 

C 

sin 

Y 

• 

V 

«  D 

C 

sin 

Y 

hp 

p 

Tp 

P 

he 

e 

Te 

5 

( 

»  • 

Integrating  V  and  V  and  remembering  that  y  and  y  are  constant 
xp  xe  p  e 

when  C  and  C  are  equal  to  zero  yields 
Lp  Le 

v  CO  *  V  (t  )  ♦  D  C  cos  y  (t  )  (t  -  t  ) 

xp  xp  ps  p  Tp  p  p$  ps 


and 


V  (t)  *  V  (t  )  ♦  D  C  COS  y  (t  )  (t  -  t  ) 
xe  xe  es  „  Te  -  ** 


p  » c  e  es  ®s 

Integrating  these  equations  and  combining  the  results, 

x  (t)  -  x  (t)  -  x  (t  )  -  x  (t  )  ♦  V  (t  )  (t  -  t  )  -  (74) 

e  p  e  es  p  ps  xe  es  es 
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nc/ur /*•#  * 


V  tt  )  Ct  -  t  )  ♦  D  C  cos  -r  (t  )  (t  -  tf/ 

xp  p>  P*  e  To  e  •*  os  2 


-DC  COS  Y  (t  )  (t  -  t  )  /- 

p  Tp  P  ps  PS  * 

The  following  equation  is  similarly  obtained  for  the  h  cooponents  of 
the  state  equations. 

h  (t)  -  h  (t)  •  h  (t  )  -  h  (t  )  -  V  (t  )  (t  -  t  ) 
e  p  e  es  p  ps  he  es  es 


V  (t  }  (t  -  t  )  ♦  D  C  sin  Y  Ct  )  (t  -  t  )  / 
bp  ps  ps  e  Te  e  es  es  2 


-  D  C  sin  y  Ct  )  (t  -  t  )  / 
p  Tp  p  ps  ps  2 

Dividing  Eq  (75)  by  (74)  and  evaluating  at  t  *  yields 

tan  C  -  (h  (t  )  -  h  (t  )  ♦  V  (t  )  (t  -  t  ) 
e  es  P  ps  he  es  f  es 


-  V  (t  )  (t  -  t  )  ♦  D  C  sin  y  ( t  )  (t  -  t  )  / 
hp  ps  f  ps  e  Te  e  es  f  es  2 


-  D  C  sin  y  (t  )  (t  «  t  )/)/{*  (t  ) 

p  Tp  p  ps  f  ps  2  e  es 

-  x  (t  )  ♦  V  (t  )  (t  -  t  )  -  V  (t  )  (t  -  t  ) 

p  ps  xe  es  f  es  xp  ps  f  ps 
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that  causes  the  evader  to  rotate  its  velocity  vector 
away  fron  the  pursuer.  Holding  this  choice  of  control 
constant,  integrate  a  turning  trajectory  for  the  evader. 

(2)  For  the  pursuer,  choose  the  control  C  or  C 

Lp  max  Lp  nin 

that  causes  the  pursuer  to  turn  in  the  direction 
necessary  to  achieve  a  tail  chase  condition.  Holding 
this  choice  of  control  constant  integrate  a  turning 
trajectory  for  the  pursuer. 

(3)  The  switching  points  (if  they  exist)  for  the  pursuer 
and  evader  amst  lie  on  these  turning  trajectories  and 
must  satisfy  Eqs  (71)  and  (72).  A  numerical  search 
is  required  to  find  the  direction  0  and  the  pair  of 
points  on  the  two  turning  trajectories  that  satisfy 
Eqs  (71),  (72),  and  (73).  If  these  switching  points 
do  not  exist  due  to  the  ability  of  the  evader  to  turn 
tighter  than  the  pursuer,  the  aircraft  will  not  switch 
from  the  turning  controls  to  the  ;ero  controls  and  the 
hard  turn  controls  will  be  maintained  over  the  complete 
trajectory.  The  geometry  of  this  solution  is  shown 

in  Figure  10. 

As  in  the  previous  chapter,  this  solution  is  an  open-loop  solution. 
However,  since  it  can  be  provided  on  a  continuous  basis,  it  constitutes 
a  closed-loop  strategy  or  control  law. 

The  importance  of  this  differential  game  problem  solution  is  that 
drag  due  to  lift  (induced  drag)  was  included  in  the  aircraft  model. 
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VIII.  MODEL  COMPARISON 


DS/MC/67-1 

The  preceding  four  chapters  were  concerned  with  the  ..solution  to  a 
pursuit -evasion  differential  game  between  two  aircraft.  The  difference 
in  these  chapters  was  in  the  model  chosen  to  represent  the  aircraft. 

The  purpose  of  this  chapter  is  to  apply  the  results  obtained  in 
Chapters  IV  thru  VII  to  the  same  game  situation  and  to  compare  the 
different  solutions.  In  doing  this  there  are  two  important  considera¬ 
tions.  The  first  is  the  payoff  or  value  of  the  game  which  is  the 
numerical  measure  that  reflects  the  relative  capabilities  of  the  two 
aircraft.  The  capability  to  determine  this  numerical  measure  through 
the  use  of  simplified  aircraft  models  would  be  a  significant  design 
tool.  The  second  consideration  is  the  correspondence  of  the  resulting 
aircraft  trajectories.  The  capability  to  determine  optimal  or  near 
optimal  trajectories  by  using  closed-loop  control  laws  developed 
through  the  use  of  simplified  models  is  important  in  the  area  of 
aircraft  tactics.  To 'accomplish" this  comparison,  two  problems  are 
considered.  These  are  the  problems  for  which  open-loop  solutions  were 
presented  in  Chapter  IV.  In  Chapter  IV,  these  problems  were  defined 
by  specifying  final  values  of  the  state  vector.  It  was  pointed  out 
that  the  solutions  to  these  problems  represented  open-loop  solutions 
for  the  differential  game  problems  where  the  specified  initial  state 

conditions  x  (t  )  corresponded  to  some  ooint  x  (t)  on  these  trajectori . 
“o'  ~ 

For  purposes  of  this  chapter,  these  problems  are  specified  in  terms  of 
initial  values  of  the  state  vector. 

Problem  1 

The  initial  conditions  for  this  problem  are 
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x  (t  )  «  19522  feet 
e  o 


x  (t  )  «  10893  feet 
P  o 


h  (t  )  «  27671  feet 

e  o 


h  (t  )  >  39984  feet 

p  o 


V  (t  )  »  857  ft/sec 
xe  o 


V  (t  )  •  1137  ft/sec 
*P  o 


V  (t  )  «  553  ft/sec 
he  o 

The  choice  of  other  necessary  data  is 

D  *  122  ft/sec2 
e 


V  (t  )  •  SOS  ft/sec 
hp  o 


D  -  192  ft/«sc 
P 


C  .  .06 

Te 


C  •  .04 
Tp 


k  «  .5 

e 


k  «  .5 
P 


The  final  ~iae  is  20  seconds  and  the  adaissible  controls  are  given  by 


icui<« 


1 V-1 


The  standard  aodel  open* loop  solution  to  this  problea  was  shown  in 

Figure  4.  In  this  problea  the  pursuer  is  initially  above  and  behind 

the  evader.  The  pursuer  has  approxiaately  a  200  ft/sec  speed  advantage 

over  the  evader  and  also  has  a  greater  acceleration  capability  by 

virtue  of  the  choice  of  0  and  D  . 

P  e 


Static  Model  Solution 

In  Chapter  V,  a  procedure  was  presented  that  would  enable  the 
static  aodel  solution  to  be  used  as  a  closed-loop  control  law.  The 
procedure  is  to  solve  the  static  problea  at  each  integration  step  as 
if  the  flight  path  direction  of  both  aircraft  is  to  resain  fixed.  The 
optiaal  controls  for  the  solution  to  the  static  problea  are  then  applied 
to  the  standard  aodel  dynaaics.  Applying  this  control  law  to  Problea  1 
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yields  the  solution  shown  in  Figure  11.  For  comparative  purposes,  the 
standard  model  solution  is  also  shown.  The  payoff  or  value  of  the  game 
is  10055  feet. 

Zero  Induced  Drag  Model  Solution 

In  Chapter  VI,  a  zero  induced  drag  model  was  presented.  By 
assuming  zero  induced  drag  and  neglecting  gravitational  forces,  an 
optimal  closcd-locp  control  law  was  obtained.  A  method  for  correcting 
for  induced  drag  was  also  discussed.  For  purposes  of  this  chapter, 
gravity  and  the  induced  drag  correction  are  included.  Applying  the 
control  law  obtained  for  the  zero  induced  drag  model  to  Problem  1, 
yields  the  solution  in  Figure  12.  The  value  of  the  game  is  10932  feet. 

Linearized  Drag  Polar  Model  Solution 

in  Chapter  VII,  an  optimal  closed-loop  solution  was  obtained  for 
a  linearized  drag  polar  model  with  gravity  neglected.  For  purposes  of 
this  chapter,  gravity  is  included.  Application  of  the  linearized  drag 
polar  model  control  law  to  Problem  1 ,  yields  the  solution  shown  in 
Figure  13.  The  value  of  the  game  is  11110  feet. 

Problem  2 

The  initial  conditions  for  this  problem  are 

x  (t  )  *  15036  feet  x  (t  )  *  9944  feet 

e  o  p  o 

h  (t  )  »  23131  feet  h  (t  )  *  19298  feet 

e  o  P  o 

V  (t  )  *  1246  ft/sec  V  (t  )  «  1403  ft/sec 

xe  o  xp  o 

V  (t  )  *  -72  ft/sec  Vv  (t  )  »  -361  ft/sec 

he  o  hp  o 
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*  o  -  Standard  Model  Solution 
A  -  Static  Model  Solution 

i 

1  .  •  - 


I 


I 


Altitude  Feet 
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o  -  Standard  Model  Solution 

A  -  Zero  Induced  Drag  Model 
Solution 


Pursuer 


Evader 


00  150.00  200.00  250.00  300.00 

*10* 

X  -  Range  Feet 


Figure  12.  Zero  Induced  Drag  Model  Solution  -  Problem  1 
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o  -  Standard  Model  Solution 

A  -  Linearized  Drag  Polar 
Model  Solution 


X  -  Range  Feet 

Figure  13.  Linearized  Drag  Polar  Model  Solution  -  Problem  1 
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The  choice  of  other  necessary  data  is 

2 

D  «  160  ft/scc  D 

e  p 


8 


175  ft/sec 


2 


C  »  .06  C  *  .04 

Te  Tp 


k  *.5 
e 


k  3.5 
P 


The  final  time  is  20  seconds  and  the  admissible  controls  are  given  by 


|cu'f 


|CLp  li* 


The  pursuing  aircraft  is  initially  below  and  behind  the  evading  aircraft. 
Although  the  pursuer  has  an  initial  velocity  advantage  of  approximately 
200  ft/sec.,  his  acceleration  advantage  over  the  evader  is  very  small. 
The  standard  model  open-loop  solution  to  this  problem  was  shown  in 
Figure  5. 

Applying  the  static  model  control  law  to  this  problem  yields  the 

solution  shown  in  Figure  14.  The  value  of  the  game  is  5863  feet. 

The  zero  induced  drag  model  solution  without  the  induced  drag 

correction  is  shown  in  Figure  15.  In  this  solution  the  "tail  chase" 

situation  is  never  achieved.  Although  the  pursuer  has  a  lift  advantage 

over  the  evader,  the  turn  rate  of  the  pursuer  is  limited  by  his 

velocity,  V  ,  since  turn  rate  is  inversely  proportional  to  velocity. 

P 

When  the  induced  drag  correction  is  included,  the  pursuer's  velocity 
is  maintained  sufficiently  low  to  allow  achievement  of  the  tail  chase 
solution.  This  solution  is  shown  in  Figure  16.  The  value  of  the  game 
for  these  solutions  is  5440  feet  with  the  induced  drag  correction  and 
4302  feet  without. 

Three  linearized  drag  polar  model  solutions  are  shown.  The 
difference  between  these  solutions  is  in  the  choice  of  the  induced  drag 


Altitude  Feet 
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'  l 


X  -  Range  Feet . 

Figure  15.  Zero  Induced  Drag  Model  Solution  without  the  Induced 
Drag  Correction  -  Problem  2 
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s 

5i 


o  -  Standard  Model  Solution 

? 

'  A  -  Zero  Induced  Drag  Model 
Solution 


X  -  Range  Feet 

Figure  16.  Zero  Induced  Drag  Model  Solution  with  the  Induced 
Drag  Correction  -  Problem  2 
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coefficient  (k).  For  the  solution  shown  in  Figure  17,  the  value  of  k 

© 

and  k  is  the  same  as  the  parabolic  drag  polar  coefficient  used  in  the 
P 

standard  model  (k  *  k  «*  .S).  Fcr  the  solution  shown  in  Figure  18,  k 
p  e  P 

and  k  are  taken  to  be  .4  and  in  Figure  19,  k  and  k  are  .33.  The 
e  p  e 

lower  coefficients  correspond  to  a  lesser  value  of  induced  drag.  The 

variations  in  these  solutions  give  an  indication  of  the  importance  of 

how  induced  dTag  is  accounted  for  in  the  aircraft  model.  The  value  of 

the  game  for  these  solutions  is 

5798  feet  for  k  *  k  *  .5 
P  e 


5412  feet  for  k  »  k  •  .4 
P  e 


5140  feet  for  k  *  k  *  .33 
P  ® 


Discussion 

For  convenience  in  comparing  the  results  obtained  in  this  chapter, 
the  payoffs  or  game  values  for  both  problems  are  summarized.  They  are 


Problem  1 

Model 

Payoff 

Standard 

>  9897  feet 

Static 

1005S  feet 

Zero  Induced  Drag 

10932  feet 

Linearized  Drag  Polar 

11110  feet 

Problem  2 

Model 

Payoff 

Standard 

5831  feet 

Static 

5863  feet 

Altitude  Feet 
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! 


o  -  Standard  Model  Solution 


X  -  Range  Feet 

Figure  17.  Linearized  Drag  Polar  Model  Solution  -  Problea  2 

(k  »  Is  »  .5) 
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o  -  Standard  Model  Solution 

A  -  Linearized  Drag  Polar  Model 
Solution 


X  -  Range  Feet 

Figure  18.  Linearized  Drig  Polar  Model  Solution  -  Problea  2 

(k  •  k  -  .♦) 

P 


Altitude  Feet 
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o  -  Standard  Model  Solution 


X  -  Range  Feet 

Figure  19.  Linearized  Drag  Polar  Model  Solution  -  Problem  2 

(k  •  k  •  .33) 
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Zero  Induced  Drag 

with  correction  S440  feet 

without  correction  4302  feet 

Linearized  Drag  Polar 

k  -  y  *  «S  S798  feet 

?  e 

k  =*  k  *  .4  5412  feet 

P  ® 

k  «  k  ■  .33  5140  feet 

P  e 

fhese  results  indicate  that  a  numerical  measure  reflecting  the  relative 
capability  between  two  aircraft  can  be  determined  by  solving  differen¬ 
tial  games  with  simplified  models.  All  of  the  solutions  to  Problem  1 
result  in  trajectories  that  exhibit  a  distinct  turning  arc  followed  by 
a  fairly  straight  approach  to  termination.  The  standard  aircraft  model 
solution  to  Problem  2  does  not  exhibit  this  charactc fistic  as  distinctly 
because  of  the  effect  of  gravity.  It  is  interesting  to  note  that  the 
line  of  sight  angle  (0)  between  the  pursuer  and  evader  at  termination 
is  nominally  independent  of  the  model  that  is  used. 

These  observations  are  used  in  the  next  chapter  to  synthesize 
a  feedback  control  law  for  the  non-linear  standard  aircraft  model. 
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IX.  CONTROL  LAN  SYNTHESIS 

In  Chapters  V,  VI,  and  VII,  optimal  closed-loop  solutions  to 
special  types  of  pursuit-evasion  differential  game  problems  were 
presented.  In  order  to  obtain  these  solutions  various  simplifications 
were  made  to  the  standard  aircraft  model.  In  Chapter  VIII,  the 
simplified  model  solutions  were  compared  with  standard  model  solutions. 
The  purpose  of  this  chapter  is  to  synthesize  a  closed- loop  control  law 
for  the  standard  aircraft  model  utilizing  information  from  the  results 
of  Chapters  V  thru  VIII. 

Control  Law  Synthesis 

The  most  important  parameter  in  the  solutions  of  the  simplified 
aircraft  problems  is  0,  the  line  of  sight  angle  between  the  two 
aircraft  at  termination.  Once  6  is  determined,  the  solution  to  these 
problems  is  known.  In  the  static  model  problem  the  optimal  controls 
are 

-  tan  (6  -  C)/(2*p) 

and 

C^  -  tan  (8  -  ♦)/(2k#) 
for 

C,  .  <  C*  <  C, 

Ip  min  —  Ip  —  Lp  max 

CLe  min  "  CLe  -  CLe  max 

Geometric  significance  can  be  given  to  this  choice  of  controls 

since  the  tangent  to  the  acceleration  vectogram  of  the  static  model  at 

* 

the  point  corresponding  to  C  is  perpendicular  to  the  final  line  of 

ip 
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sight  direction  9.  To  show  this  the  x  and  h  coordinates  corresponding 
to  this  point  on  the  vectograa  are 

x  «  0  t(C_  -  k  C  2)  cos  £  -  C*  sin  £)  (7< 

p  Tp  p  Lp  Lp 

h  «*  0  [(C  -  k  C.  2)  sin  £  ♦  C  cos  Cl  (7' 

p  Tp  p  t.p  Lp 

* 

Differentiating  Eqs  (76)  and  (77)  with  respect  to  C,  , 

*  *  ^ 

dx/dC,  «  D  l-  2k  C,  cos  £  -  sin  £)  (7) 

Lp  p  p  Lp 


dh/dC,  «  D  t-  2k  C,  sin  £  +  cos  £]  (7S 

Lp  p  p  Lp 

Combining  Eqs  (78)  and  (79), 

*  * 

dh/dx  «  (-  2k  C,  sin  £  +  cos  £]/[-  2k  C,  cos  £  -  sin  £j 
p  Lp  p  LP 

•  *  (8C 

*  (-  2k  C,  tan  £  ♦  l]/[-  2k  Cf  -  tan  £] 
p  Lp  p  Lp 

* 

with  C.  *  tan  (0  -  £)/(2k  )  Eq  (80)  becomes 

Lp  p 

dh/dx  *  (-  tan  (0  -  £)  tan  £  ♦  i)/[-  tan  (0  -  £)  -  tan  £] 

«  -  1/tan  0 

This  proves  that  the  tangent  to  the  vectogram  at  the  point  correspond- 
* 

ing  to  C.  is  perpendicular  to  0.  Figure  2C  shows  that  if  a  value  of 
Lp 

C  greater  or  less  than  C  is  chosen,  a  lower  component  of  accelera- 
Lp  Lp 

tion  is  applied  along  the  0  direction.  This  geometrically  represents 
the  pursuer's  half  of  the  saddle  point  solution.  The  optimal  control 
for  this  problem  can  be  defined  as  that  admissible  control  which 
applies  the  largest  acceleration  component  in  the  0  direction. 

In  the  zero  induced  drag  model  problem  the  optimal  solution  is 
to  employ  a  saturated  control  until  the  flight  path  direction  of  the 
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Figure  20.  Static  Model  Control  Selection  Geometry 


l 


l 


* 

\ 


vehicles  are  equal  to  0.  The  choice  of  the  saturated  control  (C  ) 

L  max 

applies  the  largest  acceleration  component  possible  in  the  0  direction 
as  can  be  seen  in  Figure  21.  When  the  flight  path  directions  of  the 
vehicles  are  in  the  0  direction  all  points  on  the  acceleration  vecto- 
grax  are  perpendicular  to  the  0  direction.  At  this  time  any  choice 
of  control  other  than  the  singular  control  C,  «  O.will  cause  the 

LpS 

aircraft  to  turn  away  from  the  desired  direction  of  flight. 

In  the  linearized  drag  polar  model  problem  the  optimal  solution 

involves  the  employment  of  saturated  controls  until 

|  tan  (8  -  y  )|  <  V  /[I  ♦  D  C  (t  -  t)/(2V  )1 

P  P  p  Tp  f  p 

is  satisfied  for  the  pursuer  and 

|  tan  (8  -  Y  3 1  <  k /U  *00  (t  -  t)/(2V  )J 
e  «  e  Te  f  e 
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Figure  21.  Zero  Induced  Drag  Model  Control  Selection  Geometry 


When  these  inequalities  are  satisfied  any  gains  made  by  continued 
application  of  the  saturated  control  are  more  than  offset  by  increased 
drag  penalties. 
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The  difference  between  this  problem  and  th*.  static  problem  is  that  6^, 

Y  ,  8  ,  and  y  are  not  constants.  The  analysis  of  the  optimal  controls 
P  •  «  * 

for  the  static  model  does  apply  on  an  instantaneous  basis  since  C  and 
•  ^ 

C  are  the  controls  that  apply  thu  largest  acceleration  component  along 

LG 

the  t»  and  0  directions  respectively.  This  suggests  a  method  of 
p  e 

synthesizing  a  closed-loop  control  law  for  the  standard  aircraft 
model  by  approximating  instantaneous  values  of  6^  and  8^.  From  trans- 
versality  conditions  for  the  standard  model  problem 
tf  (tj)  -  2.  <V  ■  5 


It  therefore  seems  reasonable  to  approximate  8  and  8  by  0.  In 

p  e 

Problem  1  of  the  previous  chapter,  it  is  observed  that  the  solutions 
for- ail  the  models  yield  values  of  0  that  are  relatively  close.  In 
Problem  2,  all  solutions  yield  reasonably  dose  values  of  0,  excepting 
the  zero  induced  drag  solution  without  the  induced  drag  correction. 

For  purposes  of  synthesizing  a  feedback  strategy  that  is  rc 'oonsive  to 
any  move  of  the  opponent,  0  must  be  determined  from  a  dynamic  rather 
than  a  static  model. 

The  following  algorithm  is  proposed  as  a  closed-loop  control  law 
for  application  with  the  standard  aircraft  model.  At  each  integration 
step 

1.  Determine  0  using  the  linearized  drag  polar  model 
solution. 

2.  Determine  the  instantaneous  values  of  control  from 

C.  -  tan  (0  -  y  )/(2k  ) 

bp  p  P 

and 

C  •  tan  (8  -  y  )/(2k  ) 

Le  e  e 
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This  control  law  uses  the  dynamics  of  the  linearized  drag  polar 
model  and  the  determination  of  control  offered  by  the  static  model. 

The  results  of  the  previous  chapter  show  that  the  payoff  resulting 
from  the  static  model  solutions  is  closest  to  the  payoff  of  the 
standard  model  in  both  problems. 

For  this  control  law  to  be  "reasonable”,  the  solution  to  a  differ¬ 
ential  game  problem  in  which  the  pursuer  and  evader  both  employ  this 
control  law  should  have  a  payoff  relatively  close  to  the  value  of  the 
game.  To  show  this.  Problem.*  1  and  2  defined  in  the  previous  chapter 
are  solved.  The  standard  model  dynamics  are  used  and  the  pursuer  and 
evader  both  employ  the  closed-loop  control  law  synthesized  in  this 
chapter.  The  solution  for  Problem  1  is  shown  in  Figure  22  and  the 
solution  for  Problem  2  is  shown  in  Figure  23.  The  numerical  results 
are 

Problem  1 

Standard  Model  Extremals  -  Game  Value  -  9897  feet 

Standard  Model  Using 

Synthesized  Control  Law  -  Payoff  -  10147  fett 

Problem  2 

Standard  Model  Extremals  -  Game  Value  -  5831  feet 

Standard  Model  Using 

Synthesized  Control  Law  -  Payoff  -  6018  feet 
It  is  seen  that  the  application  of  the  synthesized  control  law  does 
a  reasonable  job  of  duplicating  the  optimal  saddle  point  game  solution, 
implying  that  the  payoff  is  reasonably  close  to  the  value  of  the  game 
and  the  trajectories  are  also  close.  In  order  to  determine  the 
optimality  of  this  control  law,  it  must  be  tested  against  the  best 
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o  -  Standard  Model  Solution 

o 

o 

o  A  -  Synthesized  Control  Law 

Si  Solution 


X  -  Range  Feet 

figure  23.  Standard  Model  Solution  Using  the  Synthesized 
Control  Law  -  Problea  7 
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open- loop  strategy  of  the  opposing  player.  Suppose  the  evader  plays 
optimally  against  the  pursuer  who  employs  this  control  law  and  the 
resulting  payoff  is  equal  to  the  game  value  plus  a  distance  n.  This 

control  law  is  then  said  to  be  n  optimal  against  any  strategy  for  the 
evader. 

Synthesised  Control  Law  Optimality 

To  determine  the  optimality  of  this  control  law.  a  computer 
program  was  developed  that  optimizes  the  evader's  trajectory  against 
a  pursuer  employing  this  synthesized  control  law.  A  parameter  optimi¬ 
zation  problem  was  formulated  by  considering  the  evader's  control  at 
each  integration  time  step  as  an  independent  parameter. 

CLe  *  °i  i  •  1  to  t^/At 

The  parameters  ^  are  then  adjusted  to  maximize  the  distance 
between  the  pursuer  and  evader  at  termination  (t  .  tf).  This  parameter 
adjustment  was  accomplished  using  the  Random  Ray  Search  Algorithm, 
contained  in  a  program  entitled,  "Automated  Engineering  and  Scientific 
Optimization  Program  (AESOP)",  (Ref  [7]).  This  procedure  was  applied 
to  both  problems  considered  in  the  preceding  chapter.  The  solutions 
are  shown  in  Figure  24  and  Figure  2S.  The  saddle  point  solutions  are 
also  shown  for  comparative  purposes. 

By  employing  the  best  open- loop  strategy,  the  evader  is  able  to 
obtain  a  payoff  of  10S41  feet,  which  represents  a  six  and  one-half 
percent  increase  over  the  saddle  point  game  value  in  Problem  1.  fa 
the  second  problem,  the  evader  is  able  to  obtain  a  payoff  of  6319  feet 
representing  an  eight  and  four-tenths  percent  increase  over  the  saddle 
point  game  value.  It  must  be  remembered  that  these  payoffs  represent 
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the  best  that  the  evader  can  do  against  the  synthesized  control  law 
and  that  there  is  no  closed-loop  control  law  available  that  allows  the 
evader  to  achieve  these  payoffs. 
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X.  CONCLUSIONS 

Closed-loop  solutions  to  four  pursuit -evasion  differential  gaaes 
between  two  aircraft  have  been  presented.  For  the  three  siaplified 
aircraft  models  considered,  optimal  dosea-loop  control  laws  are 
found.  For  the  standard  aircraft  Model,  a  "near"  or  approxinate 
optiaal  closed-loop  control  law  is  synthesized.  The  optiaality  of 
this  control  law  is  investigated  and  found  to  be  quite  good. 

To  be  of  practical  value,  the  solution  to  a  differential  gaae 
problea  oust  provide  closed- loop  control  laws.  The  ability  to  determine 
closed-loop  control  laws  through  modeling  has  been  demonstrated  in 
this  study.  It  is  believed  that  the  same  approach  can  and  should  be 
applied  to  other  aspects  of  the  conbat  differential  gaae  with  equally 
fruitful  results  anticipated. 

It  is  hoped  that  the  approach  taken  in  this  investigation  will 
stimulate  an  interest  in  the  investigation  of  "practical"  differential 
gaae  problems. 
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APPENDIX  A:  sufficient  conditions  for  a  local  saddle  point 

.  CSC 

fhe  purpose  of  this  appendix  is  to  sketch  the  derivation  of 
•efficient  conditions  for  a  local  saddle  point  solution  to  the  differ¬ 
ential  game  problem  considered  in  this  dissertation.  The  derivation 
. «  nilar  to  that  in  Ref  [2],  which  is  analogous  to  the  approach 
taken  for  the  optimal  control  problem  in  Ref  [4]. 

\)  i f c  ror  t  i  n  1  Gnme  _P  rob  1  em 

lhe  following  differential  game  problem  is  considered.  Determine 
i  saddle  point  of 


subject  to 

x  =  f  (x,  u.  v,  t)  x  (t  )  =  x 
••  "  •*  o  -o 

'•  re  x  is  an  n-vcctor.  The  terminal  surface  is  given  by 
•  (*  («f).  tf)  =  T  -  tf  =  0 

■a.  f  is  a  specified  fixed  time  implying  that  the  game  is  of  finite 

2 

.  •'tie.t.  The  functions  i>,  f ,  and  L  are  of  class  C  with  respect  to 
.11  nents.  The  admissible  controls  u  (t)  and  v  (t)  are  subject 

• '  tkt.  constraints 

ti  .  <  u  <  u 

run  -  -  max 

v  <  v  <  v 
min  *  "  max 

.-..  d  arc  piecewise  continuous  on  [tQ,  t^j. 
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Necessary  Conditions 

Adjoining  the  differential  constraints  to  the  payoff  J  with  a 
Lagrange  multiplier  X.  (t),  Eq  (A-l)  may  be  written  as 


The  Hamiltonian,  H  is  defined  by 

T 

H  (t,  x,  u,  v)  «  x  £  ♦  L 

and  it  is  assumed  that  for  the  class  of  problems  being  considered  the 
Hamiltonian  is  separable.  This  means  that  H  can  be  separated  into 
two  functions,  one  of  which  is  independent  of  u  and  the  other  independ¬ 
ent  of  v.  Integrating  the  last  term  on  the  right  side  of  Eq  (A-2)  by 
parts,  yields 


J  ■  4  (x  (tf) ,  tf)  -  xT  (tf)  x  (tf)  ♦  xT  (t^)  x  (to) 

tf  **p 

♦  I (H  ♦  X  x)  dt 
t 


(A- 3) 


The  application  of  control  variations  du  and  6v  results  in  a  variation 

gx  in  the  state  vector  and  a  change  in  J.  The  change  in  J,  to  second 

order,  due  to  these  variations  may  be  written  as 

AJ  »  Ux  -  XT)  «x  jt  ♦  (l  6x)  |t 
-  f  o 

♦  1/2  li  «*  II2.  L  ♦  If  ecu  ♦  xT)  «X  ♦  H 

♦  t  i  u 

xx  *  o 


6u 


t,  *r 

♦  H  gvj  dt  ♦  1/2  J *  [gx  6u  gvj  H 


gx 

gu 

gv 


(A-4) 


dt 


where 
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and 


xx 


H 


ux 


vx 


H 


xu 


H 


uu 


vu 


ii 


XV 


uv 


H 


vv 


2  T 

II  5x  1 1  denotes  the  quadratic  form  fix  4  fix 
4  xx 

xx  — 


fix  is  determined  from 


fix  »  f  fix  ♦  f  fiu  ♦  f  fiv  fix  (t  )  «  0 
—  -x  "U  ~v  —  o  — 


(A-5) 


Choosing  X  =  -  H  and  A  (t  J  «  4 
“  x  ~  f  x 


,  Eq  (A-4)  can  be  written  as 


AJ  3  1/2  ||  fix  1 


XX 


t. 

♦  j  [H  6u  ♦  H  fivj  dt 

t.  t  u  v 

X  o 


(A-6) 


+  1/2  [fixT  fiu  fiv]  H 
t 

o 


fix 

fiu 

fiv 


dt 


*  *  *  * 

For(u  ,  v  )  to  provide  a  saddle  point  of  J, (u  ,  v  )  must  satisfy 

*  *  *  *  *  * 

J  (u  ,  v  +  fiv)  <  J  (u  ,  v  }  <  J  (u  ♦  fiu,  v  )  (A-7) 


for  admissible  variations  fiu  and  fiv. 

For  Eq  (A-7)  to  hold  for  any  admissible  fiu  and  fiv,  it  is 
necessary  from  first  order  considerations  of  AJ  that 


(i)  Hu  »  0 


H  »  0 
V 


(A-8) 


(ii)  H  >0 
uu  “ 


H  <0 

W  - 


*  * 

for  u  <  u  <  u  and  v  .  <  v  <  v  .If  the  minimizing  control 

mm  max  min  max 
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♦ 


*  * 

u  and  the  maximizing  control  v  are  on  the  boundaries  of  their 
admissible  sets  it  is  necessary  that 

and 


H  iu  >  0 
u  ~ 


H  dv  <  0 
v  — 


(A-9) 


Sufficient  Conditions 

•  * 

For  non-interior  u  and  v  ,  H  du  >  0  and  H  <5v  <  0  where  du  and 

u  v 

fiv  satisfy 


u  .  <  u  ♦  $u  <  u 

min  -  -  max 


V  .  <  V  ♦  dV  <  V 

min  -  -  max 


(A-10) 


are  sufficient  to  insure  that  J  (u  ,  v  )  is  at  a  saddle  point  since  the 

first  order  terms  in  Eq  (A-6)  dominate  for  small  du  and  dv. 

*  * 

For  interior  u  and  v  the  necessary  conditions,  Eqs  (A-8), 
cause  the  first  order  terms  in  Eq  (A-6)  to  vanish  and  the  variation 
in  J  is  given  by 


d2J  “  1/2  jjdx  ||Z  j  ♦  1/2  Jf  [dxT  du  dv]  H 


6x 

du 

dv 


dt 


(A-ll) 


with  x  determined  from 


dx  «  f  dx  ♦  f  du  ♦  f  dv 
—  -x  —  -u  -v 


dx  (t  )  »  0 
o  w 


(A- 12) 


and  all  functions  are  evaluated  along  the  extremal  path. 

The  accessory  minimax  problem  is  to  detezmine  a  saddle  point  of 

2 

d  J  given  by  Eq  (A-ll)  subject  to  the  differential  constraint,  Eq 
(A-12).  For  this  problem  the  minimizing  control  is  du  and  the 
maximizing  control  is  dv  and  they  must  satisfy  the  constraints  given 
by  Eqs  (A-10). 
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Assuming  that  the  strengthened  Legendre-Clebsch  conditions 

2  2  2  2 
3  H/3u  >0  3  H/3v  <  0 

are  satisfied  and  using  the  results  of  Ref  (4),  Eqs  (A-ll)  snd  (A-12) 
can  be  written  as 


.2 


J  -  1/2  ||  jx  (t  )  ||  s  ♦  f  f!l  dx  (t)  || 

f  5.  t.  a 


♦  6u2  R  -  dv2  R  J  dt 
?  • 


(A- IS) 


and 


where 


dx  »  F  dx  ♦  G  du  ♦  G  dv 
— * - ~P  ^ 


S  s  4 


«x  (tQ)  -  0 


It 


(A- 14) 


QHH  -  H  H  H  -  H  H  H 

XX  XU  uu  UX  XV  VV  vx 


R  5  H 
p  uu 

ft  5  -  H 
e  w 

F5f-fH"1H  -fH"1H 

~  ~ X  “U  UU  UX  ~v  w  vx 

G  =  f 

“p  u 

G  5  f 
e  “V 


and  all  functions  are  evaluated  along  the  extreaal  path.  The  solution 
to  this  accessory  nininax  problea,  (Ref  [2]),  yields  the  optinal 
strategies 
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iu  «  -  R  "*  G  T  I  (t.,  t)  dx 
P  ~P  ~  f  — 


6V*  •  -  R  "l  G  T  E  (t.,  t)  dx 


(A-iS) 


tdiere  r  (t^,  t)  is  the  symmetric  matrix  solution  of  the  matrix  Riccati 
equation 


1  •  •  I  P  *  FT  dx  ♦  E  (G  R  _1  G  T 

- - -~p  p  “p 


-1  T 

-6  R  *  G  )  I  -  Q 
-e  *  -e  ~ 


(A- 16) 


where 


t  (tf.  •  S 


(A- 17) 


If  Eq  (A-16)  has  a  solution  defined  on  [t#l  t^)  satisfying  Eq  (A- 17), 
then  the  only  solution  of  Eqs  (A-16)  satisfying  Eq  (A-17)  is 
du*  (t)  »  0  and  dw  (t)  ■  0 
Therefore  the  saddle  point  solution  of  the  accessory  minimax  problem 


is  at 


*  • 


(in  ■  0,  dv  «  0)  and  d  J  (du  ,  dv  )  ■  0 


since  dx  (t)  «  0.  This  implies  that 

2  * 

6  J  (du  i  0,  dv  -  0)  >  0 


«2  J  (du*  •  0,  dv  i  0)  <  0 

from  which  it  is  deduced  that 

•  *  *  •  •  • 

J  (u  ,  v  ♦  4v)  (u  ,  t  )  <J  (u  ♦  du,  v  ) 

•  • 

which  demonstrates  that  (u  ,  v  )  chosen  to  satisfy  the  necessary 
conditions  is  a  local  saddle  point  for  the  original  differential  game 
problem. 
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Conclusions 

*  * 

When  the  controls  u  and  v  are  non- interior,  the  necessary 

conditions  given  by  Eq  (A-9)  with  the  inequalities  holding  are 
*  * 

sufficient  for  (u  ,  v  )  to  provide  a  saddle  point  of  J. 

*  * 

When  u  and  v  are  interior  controls  or  no»'-intcrior  controls 

with  H  and  H  equal  to  zero,  the  following  condit  ons  are  sufficient 
u  v 
*  * 

for  (u  ,  v  )  to  provide  a  saddle  point  for  the  differential  game 
considered. 

(1)  The  strengthened  Legendre-Clebsch  conditions 

H  >  0  H  <  0 

uu  w 

(2)  The  existence  of  a  solution  to  the  matrix  Riccati 
equation,  Eq  (A-16),  on  the  interval  [t^,  t^).  In 
Ref  [2],  the  condition  when  the  solution  to  the  matrix 
Riccati  equation  becomes  unbounded  is  related  to  the 
existence  of  a  conjugate  point  on  the  extremal  path. 

These  sufficiency  conditions  do  not  apply  to  singular  arc 
solutions. 
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APPENDIX  B: 


DETERMINATION  OF  ALLOWABLE  CONTROL  SEQUENCES  FOR  THE 
DIFFERENTIAL  GAME  PROBLEM  WITH  THE  LINEARIZED  DRAG 

4  n  I  tAnri 


Purpose 

The  purpose  of  this  appendix  is  to  determine  the  allowable 
sequences  of  controls  in  an  optimal  solution  to  the  differential  game 
problem  using  the  linearized  drag  polar  model  which  is  presented  in 

Chapter  VII. 

The  state  and  costate  equations  for  this  model  are  repeated  for 


convenience.  The  state  equations,  Eqs  (48)  and  (49)  are 


x  *  V  cos  y 
F  P  P 

h  «  V  sin  y 
P  P  P 

*P  *  °p  lS '  S 1  % 11 


cb-i; 


Y  *  »  CLt/Vp 

P  P  LP  P 


X  »  V  cos  y 
e  e  e 


h 

e 


V  sin  y 
e  e 


V 

e 


D  lCT« 

e  Te 


k 


I) 


(B-2) 


Y 


e 


D  C  /V 
e  Le  e 


the  costate  equations.  Eqs  (50)  and  (51)  with  Eqs  (62)  are 


\  •  0 
*P 


(0-3) 
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***>/  *  »v-/  \»  t  —  k 


X  *  cos  (0  -  y  )  ♦  X  D  C,  /V 
VP  P  Yp  p  Lp*  p 

• 

X  *  V  sin  (8  -  v  ) 

Yp  p  V 


X  «  0 
xe 


X.  *  0 
he 


Ve  *  C0S  (°  -  V  *  \e  De  CLe/Ve' 


(B-4) 


Xve  *  V  sin  (8  -  Y  ) 

”  e  e 

In  Chapter  VII,  the  controls  that  minimize  the  Hamiltonian  are 
determned  to  be  ^  CLp  ^  >  0,  or  a  singular  control 

cLps*  Por  the  choice  ^  to  be  optimal 


(B-S) 


(B-6) 


M  «  D  t-  X  k  *  \  /V  ]  <  0 
P  P  Vp  p  YP  p1 

and  for  C  to  be  optimal 

Mn  *  °«  *xvn  K*  x  /V  J  >  0 
P  P  VP  P  YP  p 

For  CL_  *  0  to  be  optimal ,  H  must  be  positive  or  M  must  be 
"  P  P 

negative.  The  singular  control  C  occurs  if  M  *  or  M  '  is  zero 

Lps  P  p 

over  a  finite  time  interval. 


Allowable  Control  Sequences 

In  determining  allowable  sequences  of  controls,  the  physical 
aspect  of  the  problem  must  be  considered.  It  is  pointed  out  in 
Chapter  VII,  that  there  is  a  direction  8  associated  with  the  solution 
to  this  problem  and  that  this  direction  is  the  line  of  sight  direction 
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between  the  two  aircraft  at  t  ■  t^,  when  they  both  play  optimally. 
Since  this  0  direction  exists  for  optimal  play,  it  is  physically 
logical  to  assume  that  any  control  that  causes  either  aircraft  to 
turn  away  from  this  direction  is  non-optimal.  Conversely,  any  non¬ 
zero  control  to  be  optimal  must  rotate  y  and  y  toward  the  0  direc- 

P  « 

tion. 

Consider  initial  conditions  such  that  the  minimizing  control  for 
the  pursuer  is  initially  C^p  For  these  initial  conditions 


*  0  ly  k-  ♦  -_/vJ  >  0 


'p  p  yp  p 


from  Eq  (B-6).  For  C,  .  to  be  an  optimal  control,  the  physical 

Lp  •in 

aspects  of  the  problem  require  (0  -  y  )  to  be  negative.  The  allowable 

P 

sequences  of  controls  from  these  initial  conditions  can  be  determined 

by  investigating  the  behavior  of  the  switching  function  M  ",  Figure 

P 

26,-  shows  a  switching  function  trajectory  corresponding  to  the  control 

sequence  {C^  ^  CLp  •  0.  CLp  Bin>.  Mp’  (tf)  equals  zero  since 

Xyp  (t^)  and  A^  (t^)  are  zero  from  transversality  conditions,  Eqs 

(S2).  To  show  that  this  sequence  is  not  an  optimal  sequence,  the 

derivative  of  N  ”  is 
P 


4*«D[At/k  »A/V-A  V/VJ 
p  P*Pp  TP  p  ip  P  P 


(B-7) 


Substituting  for  A„  ,  A  ,  and  V  using  Eqs  (B-l)  and  (B-3),  Eq  (B-7) 
VP  YP  p 

becomes 


M  »  D  [k  cos  (0  -  y  )  ♦  sin  (0  -  y  ) 
P  P  P  P  P 


A  D  C,.  /V  J 
YP  P  Tp  p 


It  is  seen  in  Figure  26,  that  to  end  on  a  C  arc,  H 

Lp  min  p 

must  be  negative.  This  implies  from  Eq  (B-8)  that 


(B-8) 

V 
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Figure  26.  Switching  Function  Trajectory  for  the  Control  Sequence 

{C  .  ,  C.  •  0,  C,  .  > 

Lp  am  Lp  Lp  mm 


tan  (0  -  y  }  I  <  -  k 


since  X 


(tj  >  0  froa  transversal ity  conditions^  For  the  sequence 
TP  t 


(C,  .  ,  C,  *  0,  C,  .  }  to  exist,  M  Bust  be  zero  at  t  <  t  . 

Lp  mm  Lp  Lp  ain  p  if 

From  Eq  (B-8)  this  occurs  when 

k  cos  (8  -  Y  >  ♦  sin  (0  -  v  )  «  X  D  C /V 2  I 

P  p  p  TP  P  Tp  p 


It  has  been  stated  that  the  physical  aspects  of  the  problea  require 

(0  -  y  )  to  be  negative  for  the  control  C  to  be  optimal.  Eq 

p  Lp  ain 

(B-9)  confirms  this  requirement.  For  negative  (8  -  y  ),  X  is 

P  YP 

negative  and  X  must  be  positive  in  order  to  satisfy  X  (C J  «  0. 

Yp  Yp  r 

This  implies  that  the  right  hand  side  of  Eq  (B-10)  is  positive  and 
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ttn  (0  -  y  )  I  »  -  k  (B- 11) 

P  P 

Eqs  (B-10)  and  (B-ll)  imply  that  y  has  increased  with  time  which  is 

P 

not  possible  with  the  control  C  It  is  concluded  that  the 

control  sequence  {C^  ■  0,  is  not  an  optical  sequence 

A  sore  basic  conclusion  is  that  M  cannot  be  zero  for  t  <  t.  if  the 

P  f 

solution  is  to  end  on  a  C,  .  arc.  This  result  i3  used  in  the 

Lp  sin 

following  analysis. 


Singular  Controls 

The  question  whether  or  not  singular  controls  exist  for  this 
problea  is  now  considered.  Initial  conditions  are  again  chosen  such 
that  the  minimizing  control  for  the  pursuer  is  initially  C 

Lp  Bin 

Figure  27  shows  three  switching  function  trajectories  containing 
singular  controls. 


Figure  27.  Switching  Function  Trajectories  Containing  Singular  Arcs 
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Trajectory  1,  in  Figure  27,  corresponds  to  the  control  sequence 

(C,  .  ,  C  ,  C  }.  This  sequence  can  be  eliminated  as  a  possible 

Lp  min’  Lps  Lp  min 

optimal  sequence  by  the  results  previously  obtained  which  conclude  that 

M  cannot  be  zero  for  t  <  t  if  the  solution  is  to  end  on  a  C, 
p  f  Lp  min 

arc. 


Trajectory  2,  in  Figure  27,  corresponds  to  the  control  sequence 

(C  }  and  trajectory  3  corresponds  to  the  sequence  {C  ,  C  , 
Lps  r  n  Lp  min  Lps 

C  »  0}. 

P  -  *  - 

The  sequence  (C  }  implies  that  M  “  and  M  are  zero  along  the 
Lps  p  p 

singular  arc.  To  show  that  this  is  not  an  optimal  sequence,  setting 


M  (t  )  equal  to  zero  implies 
P  f 

tan  (0  -  y  ) 

P 


(B- 12) 


iiq  (B-12)  implies  that  (0  -  y  )  is  negative  and  from  Eq  (B-3)  A  is 

p  Yp 

negative.  Therefore,  for  t  <  t  ,  A  must  be  positive  to  satisfy 
.  ^ 

A  (t J  a  0.  M  must  be  zero  for  all  t.  For  t  <  t  Eq  (B-8)  implies 
Yp  f  p  f  ^  v 


k  cos  (0  -  y  )  ♦  sin  (0  -  y  )  *  A„  D  C  /V  *  >  0  (B-13) 

P  P  P  YP  P  Tp  p 


Hq  (B-13)  yields 

tan  (0  -  y  )  I  >  -  k  (B- 14) 

P  P 

Eqs  (B-12)  and  (B-14)  imply  that  the  singular  control  has  rotated  the 


flight  path  direction  of  the  pursuer  away  from  the  final  line  of  sight 
direction  6.  It  is  concluded  that  an  optimal  solution  to  this  problem 


cannot  terminate  on  a  singular  arc. 

The  remaining  control  sequence  to  consider  is  {C  .  ,  C  , 

Lp  min  Lps 

C  *  0)  which  corresponds  to  trajectory  3  in  Figure  27.  Let  t  *  t 
Lp 

denote  the  time  of  switching  from  the  singular  to  the  C  *0  arc. 

Lp 
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For  t^  <  t  <  t^,  Mp  must  equal  zero.  This  implies  from  Eq  (B-8)  that 


tan  (0  -  y  )  I  >  -  k 


(E-1S) 


since  X  D  C  /V  is  positive  for  reasons  already  stated.  For 
Yp  p  Tp  p 

•  •» 

t  >  t^,  Mp  must  be  negative  from  Figure  27.  This  implies,  using  Eq 
(B-8),  that 


tan  (©  -  y  )  <  -  k 

p  t>tx  p 


(B-16) 


Eqs  (B-15)  and  (B-16)  imply  that  the  singular  control  has  rotated  the 
flight  path  direction  away  from  the  0  direction.  This  control  sequence 
is  therefore  not  optimal. 

♦  •  ♦ 

Similar  arguments  can  be  made  using  M  and  M  to  show  that  the 

P  P 

sequences 

{C  ,  C,  -  0,  Cf  ),  {C  ,  C,  ,  C  ), 

Lp  max  Lp  Lp  max  Lp  max  Lps  Lp  nx 


{Ci  •  c,  .  C,  »  0) 

Lp  max  Lps  Lp 

are  not  optimal  control  sequences.  Control  sequences  involving 
switching  between  maximum  and  minimum  controls  are  not  optimal  because 
they  imply  a  rotation  away  from  the  terminal  line  of  sight  direction 


Conclusions 

Ihe  conclusion  is  that  for  the  pursuer  the  following  control 

sequences  are  candidates  for  an  optimal  solution: 

(C  or  C  ,  C  »  0),  (C,  or  C  },  (C  •  0) 

Lp  max  Lp  min  Lp  Lp  max  Lp  min  Lp 


10S 
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An  analysis  similar  to  this  for  the  evador  leads  to  the  conclusion 
that  an  optimal  solution  consists  of  one  of  the  following  control 
sequences: 


(C  or  C  , 

Le  max  Le  min 


(Ct  orC,  k  {C 
Le  max  Le  min  Le 


0} 


aSJfc 
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